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ABSTRACT 


A  model  for  the  auxiliary-  memory  function  of  a 
segmented,  multi-processor,  time-shared  computer 
system  is  set  up.  A  drum  system  in  particular  is 
discussed,  although  no  loss  of  generality  is  implied 
by  limiting  the  discussion  to  drums.  Particular  attention 
is  given  to  the  queue  of  requests  waiting  for  drum 
use.  It  is  shown  that  a  shortest  access  time  first 
queue  discipline  is  the  most  efficient,  with  the 
access  time  being  defined  as  the  time  requir *  for 
the  drum  to  be  positioned,  and  is  measured  from  the 
finish  of  service  of  the  last  request  to  the  beginning 
of  the  data  transfer  for  the  present  request.  A 
detailed  study  cf  the  shortest  access  time  queue  is 
made,  giving  the  minimum  access  time  probability 
distribution,  equations  for  the  number  in  queue, 
and  equations  for  the  wait  in  the  aueue.  Simulations 
were  used  to  verify  these  equations;  the  results 
are  discussed.  Finally,  a  general  Markov  Model  for 
Queues  is  discussed  in  an  Appendix. 
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CHAPTER  I.  INTRODUCTION . 

With  the  advent  of  more  and  more  complex  computing 
systems  It  has  become  Increasingly  Important  to  have  some 
reliable  means  for  evaluating  the  performance  of  the  system. 

In  the  Compatible  Time-Shared  System  (CTSS)  at  Project  MAC  (2), 
M.I.T.,  for  example,  the  scheduling  of  users  Is  a  problem 
that  Is  receiving  much  attention.  Patel  (14)  has  considered 
flrst-come-flrst-served  allocation  of  processor  resources 
to  users,  and  a  multiple-level  dynamic  priority  scheduling 
algorithm  which  closely  models  the  scheduling  algorithm  used 
in  CTSS  (2),  Heller  (10),  on  the  other  hand,  has  considered 
the  more  general  problem  of  a  multiple-processor  time-shared 
system.  The  purpose  of  the  scheduling  algorithm  Is  to  allocate 
the  processor  resources  as  efficiently  and  equitably  as 
possible,  minimizing  processor  ldl-  time  and  user  waiting 
time.  Various  schemes  for  scheduling  have  been  tested  at 
MAC  but  the  one  described  by  Patel  has  proved  most  satisfactory. 
Scherr  (17)  has  made  a  far-reaching  study  of  CTSS-llke  systems, 
with  particular  emphasis  on  their  Markovian  aspects. 

Before  the  user's  waiting  time  can  be  minimized  It  is 
necessary  to  minimize  the  processor  idle  time.  One  of  the  most 
Inefficient  operations  Is  the  swapping  of  Information  between 
the  core  memory  and  the  drum  or  disc  flies.  Oftentimes  the 
processor  must  stand  Idle  during  a  swap,  awaiting  the  arrival 
In  core  of  a  block  of  data.  One  way  to  ease  this  difficulty 


Is  to  use 
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one  or  more  processors  and  let  several  programs  occupy  core 
at  once.  Then  during  the  time  that  the  swapping  for  one 
program  Is  taking  dace,  the  processors  can  be  kept  busy  on 
other  probrams.  In  this  way  overall  processor  Idle  time  can 
be  reduced.  These  ideas  of  mult lprogrammlng  and  multiple 
processors  are  not  new;  It  Is  only  recently  that  computer 
hardware  has  become  sufficiently  sophisticated  to  handle  the 
task  effectively. 

Additional  alleviation  of  the  swapping  problem  can  be 
effected  by  making  drum  and  disc  file  operation  as  effiolent 
as  possible.  In  single -program  systems  efficiency  of  drum 
operation  Is  not  a  problem  since  only  one  program  ( the  program) 
can  demand  use  of  the  drum  at  a  time.  Clearly,  In  a  multi- 
programmed  system  several  programs  can  make  simultaneous 
demands  on  the  drum  and  disc  facilities,  miking  special 
organization  a  must  to  minimize  the  waiting  time  of  a  given 
program  for  Its  request  to  be  serviced,  and  at  the  same  time 
minimizing  Idle  time  of  the  entire  system.  It  Is  clear 
that  In  a  poorly  organized  drum  system  the  Inefficiency  of 
the  drum  system  can  seriously  impair  the  operation  of  the  rest 
of  the  computing  system  because  continued  operation  often 
depends  on  the  rending  of  Information  Into  core:  a  program 
cannct  begin  to  operate  a  segment  until  that  segment  has  been 
placed  In  core.  For  Instance,  suppose  we  had  at  our  disposal 
the  means  to  reduce  the  average  service  time  of  a  drum  request 
by  two  or  three  milliseconds.  In  the  two  or  three  milliseconds 
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saved  much  computation  can  be  performed. 

In  this  paper  we  consider  a  model  for  a  drum  file 
memory  system,  and  In  particular  a  model  for  the  programs 
In  suoh  a  system.  The  model  will  describe  the  manner  In 
which  a  program  (or  more  properly,  a  process)  makes  requests 
for  file  memory  use.  A  computer  simulation  has  been  written 
for  the  particular  model  described.  In  Chapter  4  a  pertinent 
mathematical  model  Is  given.  In  Chapter  5  the  results  obtained 
from  this  model  are  compared  with  the  results  obtained  from 
the  simulation.  The  Interested  reader  Is  referred  to 
Scherr  v 17 )  and  to  Appendix  4  for  an  outline  of  the  complexity 
of  even  the  most  tractable  of  models,  the  Markov  Model. 
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CHAFfER  2.  BACKGROUND. 

It  Is  the  purpose  of  this  section  to  dlsouss  some 
of  the  concepts  upon  which  this  paper  Is  based.  One  of  the 
problems  of  existing  time-shared  systems  Is  that  the  processor 
must  st^nd  Idle  while  the  present  and  next  user’s  orograms 
are  being  swapped  In  or  out  of  core.  One  proposed  solution 
to  the  oroblem  is  to  run  one  user’s  program  In  core,  meanwhile 
swapping  the  next  user  into  a  remaining  cart  of  core.  Then 
the  processor  would  be  switched  to  the  next  user,  and  the 
swapping  operation  would  begin  anew.  Of  course  each  user 
would  not  be  arbitrarily  assigned  half  of  core,  but  programs 
would  be  matched  In  some  complementary  manner  long  ones  with 
short  ones.  This  mode  of  overlapped  operation  In  a  time-shared 
system  Is  sometimes  referred  to  as  a  ring  (cf.  Scherr  (17)). 
Again,  Idle  processor  problems  arise  If  one  program  should 
require  all  available  core  space.  Then  no  simultaneous 
swapping  could  take  place. 

A  generalization  of  the  above  solution  to  'che  problem 
has  been  considered  at  length  by  J.B,  Dennis  and  E  Van  Horn  (3*6). 
It  Is  known  as  segmentation.  Under  this  cheme  a  user's 
program  would  be  divided  Into  a  set  o.  *  dlvldually  named 
pa~ts,  called  segments.  The  user  Is.  assumed  to  have  segmented 
his  program  In  the  way  which  seems  most  appropr  .  to  him. 
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Segments  may  be  classified  roughly  according  to  the 
manner  in  which  they  may  be  aocessed: 

(1)  Read-Only. 

(2)  Data. 

(3)  Pure  procedure. 

Some  combinations  of  these  classes  are  permitted. 

A  pure  procedure  segment  is  a  set  of  Instructions 
which  directs  a  process*  to  operate  on  data  but  not  on  Itself. 
Thus  we  could  ask  the  compiler  to  extract  all  the  symbols, 
variables  and  so  forth,  from  a  program  and  group  them  Into 
one  segment;  procedure  segments  would  then  be  allowed  to 
modify  and  use  this  data.  Of  course  certain  programs,  notably 
short  ones,  would  be  contained  entirely  In  one  segment. 
Read-Only  data  might  be  Input  data,  format  specifications, 
and  so  forth,  which  are  not  altered  by  the  processes  In  a 
user's  computation.  Operation  of  a  program  might  be  In  the 
following  manner.  Some  first  segment  would  be  brought  Into 
core,  together  with  all  necessary  data  segments,  which  may  or 
may  not  Include  read-only  data.  Then  segments  may  act 
singly  or  In  groups  (If  several  processors  are  available) 
on  the  data.  New  segments  are  brought  In  as  needed  (when 
a  reference  Is  made  to  a  segment  not  already  in  core).  The 
programmer  may  wl3h  to  declare  subroutine  segments, 
which  might  contain  some  of 

* 

K  process  Is  carried  out  bv  a  processor  under  the  direction 
of  Instructions  in  procedure  segments,  (3.^.7). 
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his  often-used  subroutines,  and  which  for  efficiency'  sake 
should  be  kept  handy  in  core  at  ail  Limes.  Of  course  certain 
subroutines,  such  as  printing  or  exponentiation  subroutines, 
might  be  kept  in  special  common,  or  library  segments,  being 
available  for  the  common  use  of  all  users.  In  this  way  each 
user  would  not  need  to  be  given  his  own  copy  of  each  and 
every  library  routine.  Figure  2.1  suggests  the  operation 
of  the  system,  showing  a  time  sequence  of  groups  of  segments 
operating  on  data.  The  time  sequence  may  not  be  In  the  order 
In  which  the  segments  were  written,  and  the  same  segment  may 
appear  many  times  in  the  sequence.  Several  processors  might 
be  available  to  work  for  one  user,  so  that  several  segments 
might  be  active  at  once.  Note  that  we  have  indicated  that 
the  segments  are  In  general  of  various  lengths.  Note  too 
that  read-only  data  may  not  need  to  be  present  In  core  (main 
memory )  but  may  be  referenced  from,  say,  a  drum  memory 
(auxiliary  memory)  as  needed. 

Clearly,  by  writing  programs  In  segments,  only  a  few 
segments  of  a  given  program  need  be  In  core  at  once,  the  rest 
being  stored  in  auxiliary  memory,  perhaps  on  a  high  speed 
drum.  A  segment  in  core  which  Is  being  used  by  one  or  more 
processes  Is  called  a  working .  or  active  segment.  Segments 
kept  on  the  drum  are  called  dormant  segments.  Many  users, 
or  course,  can  have  segments  working  simultaneously  if  there 
Is  more  than  one  processor  available.  When  a  segment  Is 
working  it  can  have  one  or  more  processes  taking  place  In  It, 
depending  agoin  on  how  many  processors  are  available  to  work 
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Figure  2.1.  Operation  of  one  user  In  a  segmented  system 
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on  It.  Hence  when  talking  of  the  computations  within  a 
user's  set  of  segments,  we  shall  spe«k  of  a  user’s  processes 
rather  than  a  user's  program. 

Eaoh  segment  will  be  named  in  some  arbitrary  manner. 
When  a  process  makes  reference  to  a  segment  (by  naming  it 
and  giving  the  address  of  some  word  within  it)  which  is 
not  in  core,  that  process  is  temporarily  suspended  until 
'-he  required  segment  is  brought  into  core.  Since  many  users 
may  have  simultaneous  processes  it  will  be  necessary  to  have 
some  central  control  over  allocation,  swapping,  and  so  forth. 
The  program  which  does  this  job  is  called  the  Supervisor 
program.  When  a  process  references  a  segment  other  than  the 
one  in  which  it  is  taking  place,  the  Supervisor  will  transfer 
control  to  that  segment  if  it  is  in  core.  Otherwise  that 
process  must  halt  until  the  Supervisor  has  brought  in  the 
needed  segment.  With  many  processes  running  the,re  will  be 
a  great  demand  for  drum  usage.  We  think  of  a  process  causing 
a  request  to  be  made  to  the  drums  for  information,  rather  than 
the  process  itself  making  the  request.  We  can  see  that 
references  to  other  segments  are  at  arbitrary  points  in  time, 
and  may  be  to  arbitrary  segments,  which  may  have  arbitrary 
length. 
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If  requests  should  be  generated  momentarily  faster 
than  they  can  be  serviced,  then  the  waiting  requests  must 
be  places  In  a  waiting  line,  or  queue.  Tte  order  In  which 
requests  are  serviced  (l.e.,  the  order  In  which  they  leave 
the  queue)  is  not  necessarily  the  order  In  which  they  arrived 
at  the  queue.  We  can  see  three  distinct  parts  of  the  data 
transmission  function  of  the  computing  system:  the  users* 
processes,  which  generate  requests  (either  to  read  ^r  to 
write  on  the  drum);  a  queue  Into  which  requests  that  have 
to  wait  are  placed,  and  which  has  a  selection  rule  for  next 
out,  c«lled  the  queue  discipline:  and  finally  the  drums. 

One  final  word  must  be  said,  concerning  the  trans¬ 
mission  of  data  to  and  from  the  drums.  It  seems  both  desires ble 
and  convenient  to  have  some  standard  unit  of  transmission 
and  allcjatlon.  whloh  we  call  the  page.  It  Is  always 
possible  to  store  pages  consecutively  on  the  drum  (see  Section 
3.4).  This  requires  that  there  exist  some  mechanism  for 
deleting  unnecessary  data  from  the  drums.  One  possible 
mechanism,  using  a  percentage  level  of  drum  occupancy.  Is 
discussed  In  Section  3.4.  It  Is  necessary  for  the  Supervisor 
to  maintain  some  level  of  drum  occupancy,  and  to  have  a 
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deletion  policy  In  order  to  keep  the  drum  from  overflowing. 

We  will  see  under  our  study  of  queues  in  Section  3.3 
and  Chapter  4  that  for  each  reouest  there  Is  a  certain  drum 
oositlonlng  time,  or  access  tlm^.  that  must  pass  while  the 
requested  starting  page  comes  opposite  the  drum's  read-wrlte 
heads.  This  access  tlmc  Is  wasted  time.  We  seek  to 
minimize  It. 

There  are  two  general  methods  of  handling  core  allocation, 
and  it  Is  not  clear  which  method  is  more  deslreable.  One 
method  Is  called  page-turning,  the  other  segment -turning. 

Under  both  methods,  a  set  of  pages  will  be  grouped  as  a 
segment  and  glv^n  a  name.  Under  segment-turning  a  whole 
segment  Is  brought  Into  core  and  kept  there  at  least  until 
the  various  processes  are  finished  with  It.  Under  page-turning, 
one  page  of  a  segment  at  a  time  Is  brought  In,  and  a  new 
pag°  is  brought  In  only  when  needed.  Under  page-turning 
unneeded  pages  are  deleted  singly,  while  segment- turn 'ng 
deletes  the  entire  set  of  pages  belonging  to  a  segment  If 
any  one  of  them  Is  deletable.  Page-turning  seeks  to  minimize 
wasted  core  space;  segment-turning  seeks  to  minimize  overall 
processing  time  per  user.  Each  method  has  its  advantages 
and  disadvantages.  There  Is  some  evidence  that  neither  is 
better  (of  Scherr's  Thesis,  where  It  Is  shown  that  the 
scheduling  and  comoutatlonal  time  quanta  do  not  significantly 
affect  system  operation  (17)).  This  paper  assumes  a  segment¬ 
turning  system. 


i 


16 


4 


In  conclusion!  when  a  user’s  process  refers  to 
another  segment  the*  Is  not  present  In  core.  It  will  cause 
the  Supervisor  to  generate  a  request  to  the  drums.  Ordinarily 
a  request  will  be  a  read  request,  but  It  might  also  be  a  write 
request  If  the  referenced. segr  nt  Is  one  In  oore  being  declared 
In  the  reference  as  "dormant";  or  It  may  be  a  delete  request 
if  the  referenced  segment  is  being  declared  "dead".  The 
queue  will  contain  the  waiting  requests,  while  the  drums  will 
service  them.  A  proper  deletion  policy  Is  needed.  Finally 
It  is  clear  that  the  unit  of  Information  transmission  ought 
to  be  the  page,  but  the  core  memory  allocation  question,  namely 
whether  to  allocate  In  pages  or  in  segments.  Is  open  for 
disousslon. 
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CHAPTER  2.  THE  DRUM  SYSTEM. 

3.1.  Introduction. 

The  system  model  described  here  consists  of  three 
elements!  the  Users*  Processes,  the  Queue .  and  the  Drums. 

The  Users*  Processes  element  models  requests  to  the  Drums 
to  read,  write,  or  delete.  The  Processes  will  make  requests 
at  certain  Intervals  given  by  some  inter-request-tlme  probability 
distribution;  they  will  request  some  quantity  of  data  In  units 
of  pages,  beginning  at  a  speolx’led  location  on  the  drum.  Several 
drums  may  be  present,  so  each  request  will  specify  which 
drum  Is  Involved.  Delete  requests  will  be  sent  directly  to 
the  drums,  while  read  and  write  requests  will  be  entered  In 
the  Queue.  The  Queue  will  contain  a  list  of  which  processes 
are  requesting  how  much  data  from  (or  to)  what  drum,  andthe 
starting  location  of  the  drum.  It  will  aot  according  to 
some  queue  discipline  to  decide  which  request  Is  next  to  reach 
the  drum,  and  will  assign  the  request  to  a  free  channel  to 
the  requested  drum.  When  a  request  Is  assigned  to  a  channel  It 
Is  deleted  from  the  Queue.  When  a  arum  is  notified  by  the 
Queue  that  a  request  Is  assigned  to  a  channel  it  takes  note 
of  what  program  has  been  assigned  to  the  ohannel,  what  the 
desired  starting  location  and  field  are,  and  whether  the 
request  Is  a  read  or  a  write.  A  certain  amount  of  time 
roust  elapse  before  the  desired  location  has  revolved  Into 
position;  this  time  Is  the  access  time.  Once  the  desired 
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starting  position  has  conus  opposite  the  drum  heads  the  data 
transfer  begins,  and  ends  after  a  certain  amount  of  time, 
the  transfer  time .  has  elapsed,  The  sum  of  the  access  time 
and  the  transfer  time  Is  called  the  service  time .  The 
channel  Idle  time  Is  the  time  during  which  the  channel  has 
no  reauest  assigned  to  It.  There  may  be  some  question  whether 
access  time  should  be  Included  in  channel  Idle  time.  Since 
access  time  directly  affects  a  V.ven  reauest' s  wait  before 
the  end  of  its  service,  we  h've  included  It  In  the  service 
time.  Figure  3.1  shows  the  system  In  block  diagram  form, 
as  we  have  just  outlined  It. 

We  now  ?lve  a  complete  description  of  each  element 
starting  with  the  most  basic,  and  most  probabilistic,  the 
Users'  Processes. 


3.? .  The  Users'  Processes  Model. 

In  order  for  proper  control  of  all  computing  facilities 
to  be  maintained,  the  Individual  processes  In  core  do  not 
make  reouests  directly  to  the  queue  and  drums.  As  discussed 
In  Chapter  2,  a  request  originates  from  the  Supervisor,  the 
program  which  controls  allocation  and  proper  operation  of 
the  system  facilities.  The  Supervisor  can  prevent  Interaction 
between  processes,  providing  protection  against  such 
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happenings  as  some  process  erroneously  requesting  to  write 
on  top  of  another’s  information.  The  Supervisor  will  contain 
the  queue. 

In  order  to  ^remote  efficient  operation,  program  seg¬ 
mentation  will  be  used  (3,6).  By  breaking  the  program  into 
segments,  efficient  use  can  be  made  of  core  memory,  since 
those  segments  of  a  program  in  which  no  processes  are  presently 
taking  place  should  be  stored  on  the  drum  and  should  not  be 
"cluttering  up"  core.  When  a  process  references  a  segment 
not  in  core,  the  Supervisor  will  request  that  the  next 
segment  or  segments  be  brought  into  core.  Clearly  while  the 
next  segment  or  segments  are  being  read  into  core,  any  waiting 
processes  are  suspended;  hence  our  first  assumption; 

Assumption  1  Once  a  process  has  caused  a  request  for 
one  or  more  segments  to  be  read  in.  it  is  temporarily 
syspended  until  its  new  segments  are  brought  in.  In 
particular  a  process  will  be  unable  to  caus*  further 
reouests  until  at  least  the  time  when  it  is  resumed. 

On  the  other  hand,  during  the  course  of  computation  a 
process  may  generate  some  output  data  in  core  and  request 
that  this  data  segment  be  stored  on  the  drum,  for  example 
so  that  it  can  reuse  the  same  core  space  for  further  data. 

Such  write  requests  do  not  imply  that  the  process  must  come 
to  a  halt,  hence  our  second  assumption; 

Assumption  2.  Upon  generating  a  write  reauest  a 
process  may  continue v  and  in  particular  it  may  cause 
further  read  or  write  requests  while  a  write 
reauest  is  being  serviced. 


s 
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Prom  the  above  discussion,  we  may  expect  that  a  read 
request  Is  more  probable  than  a  write  request,  and  so  our 
third  assumption: 

Assumption  The  probability  of  a  process  causing 
a  read  request  Is  not  the  same  as  that  of  it  causing 
a  write  request,  and  In  general  the  probability  of 
a  read  Is  greater  than  that  of  a  write. 

In  crder  to  simplify  space  allocation  on  the  drums, 

the  surface  of  the  drum  will  be  divided  into  blocks,  or 

pages,  consisting  of  some  fixed  number  of  words.  Thus  the 

numbpr  of  words  per  page  Is  fixed,  and 

Assumption  4.  The  unit  of  Information  transmission 
and  storage  will  be  the  page. 

We  have  no  reason  to  assume  that  the  number  of  pages  in  an 
arbitrary  segment  Is  fixed;  In  fact  all  we  can  say  is  that 
long  segments  (those  with  many  pages)  will  be  unlikely  as  will 
extremely  short  segments  (for  example  one  or  two  pages). 

The  number  of  segments  In  a  block  of  n  pages  la  a  random 
variable,  and  In  particular  the  probability  of  finding 
exactly  n  pages  In  s  segments  may  be  given  by  a  discrete 
Poisson  Distribution: 


P( s,n) 


n=0 ,1,2 , , . . 
s=l ,2,3,... 


(1) 


where  the  mean  number  of  pages  per  segment  Is  N, 

Consider  this  problem:  If  a  process  should  reference 
more  than  on®  segment  not  In  core,  so  as  In  Initiate  the 
read-ln  of  several  segments,  should  the  Supervisor  ask  for 


the  several  segments  In  a  single  request,  or  should  It 
make  separate  requests,  one  for  each  segment'  v«s  are  assuming 
that  It  Is  always  possible  to  store  the  pages  of  a  given 
segment  sequentially  on  the  drum,  that  is  that  we  can  •.-.lr>«ys 
read  or  write  a  segment  without  interrupting  the  transmission 
between  start  and  finish.  How  this  is  done  is  considered  in 
some  detail  in  Section  J.b.  For  three  reasons  we  argue  that 
in  the  event  of  need  of  several  segments  contemporaneously 
there  should  be  a  senarate  request  made,  one  for  each  segment. 
Fi-*st,  since  consecutive  segments  may  not  be  all  written 
at  once,  but  may  have  been  written  at  widely  spaced  intervals, 
and  independently  or  each  other,  it  is  unreasonable  to  assume 
that  segments  will  always  be  stored  consecutively;  although 
this  could  be  done  by  the  method  of  Section  3-^.  Second, 
there  is  no  assurance  that  the  requested  segments  will  all 
be  on  the  same  drum,  or  that  the  request  will  even  be  for 
consecutive  segments.  Finally  some  queue  disciplines 
discriminate  against  long  requests,  servicing  those  requiring 
the  shorted  service  times  first  (Section  3.3);  asking  for 
several  segments  in  one  request  could  well  result  in  an 
inordinately  long  wait  for  service  under  such  a  queue  discipline. 
We  now  make  our  fifth  and  sixth  assumptions. 

Assumption  Each  request  will  be  for  one  segment, 
but  at  a  request  time  a  process  may  cause  several 
requests.  The  probability  that  s  segments  will  be 
requested  will  be  exponential,  that  is 

P(s)  =  e"s  s^l,2,... 


(2) 
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Furthermore  at  request  time  there  Is  no  reason  for 
all  the  requests  to  be  either  all  read  or  all  write; 
they  may  be  mixed,  A  read  request,  or  course,  will 
cause  suspension  of  the  process. 

Assumption  6.  The  number  of  pages  in  the  single 
segment  of  each  request  will  have  probability  of 
being  n  pages 

P(n)  =  e"n//N  n=0,l,2, . . .  (3) 

ir 

where  N  is  the  mean. 

When  a  segment  is  active,  that  is,  when  processes  are 
referencing  it,  the  probability  that  the  next  requests  occur 
at  each  successive  time  instant  are  independent  so  that  we 
expect  tha  arrival  times  or  requests  to  be  Poisson 
Distributed.  A  request  is  unlikely  to  be  mane  Immediately 
after  resumption  of  a  process  from  the  last  request;  and  it 
is  unlikely  to  be  made  an  extremely  long  time  after  the 
resumption  of  a  process.  The  probability  of  exactly  k 
requests  in  a  time  Interval  t  is 

P(k,t)  *  e"at  t  >  0  (4) 

where  a  is  the  average  number  of  arrivals  per  unit  time. 

We  have  then 

Assumption  £.  The  inter-request  times  are  taken  from 
the  following  distribution* 

P(t)  -  ae"at  t  >  0  (5) 


*See  page  60 
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Something  must  be  said  about  the  starting  position  of 

the  drum  a  particular  request  will  seek.  We  have  no  information 

to  allow  us  to  assume  anything  other  than  that  all  drum 

positions  are  equally  likely  to  be  requested. 

Assumption  8.  At  a  particular  request  time  all  drum 
positions  are  equally  likely  to  be  selected;  that  is, 
the  density  of  angular  positions  requested  will  be 

P(6)  *  ^  0  <  6  <  2rt  (6) 

Finally  something  must  be  said  about  which  drum  is  to 

be  requested,  in  the  event  that  there  are  several  drums  in 

the  system.  When  a  process  is  making  requests  for  several 

segments  there  is  no  reason  to  assume  that  all  the  requested 

segments  will  be  on  the  same  drum.  Hence  we  are  willing  to 

say  that  each  of  the  D  drums  Is  equally  likely  to  be  requested! 

Assumption  £.  E*»oh  request  is  equally  lively  to 
be  for  any  of  the  drums  in  the  system. 

Assumptions  3. 5*7,8,  and  9  are  illustrated  in  Plgures  3.2 

to  3.7. 


Based  on  the  discussion  above,  we  are  in  a  position  to 
construct  a  model  for  the  request  activity  of  a  given 
process.  This  model  is  shown  in  Figure  8.* 


*A  Note  on  Notation:  A  fork  is  a  point  at  whioh  one  process 
splits  into  two  processes,  which  follow  their  own  paths.  A 
loin  is  .lust  the  opposite,  where  two  prooesses  become  one;  each 
time  the  join  is  entered  the  operations  in  the  box  of  the 
flow  chart  are  carried  out.  An  arrow  doing  this  I 

is  a  termination  of  a  prooess.  A  note  in  brackets  gives  the  ■ 
condition  permitting  a  prooess  to  emerge  from  the  corres¬ 
ponding  box.  A  function  written  with  an  argument  (.)  denotes 
a  probability  function  for  a  set  of  identically  distributed 
random  variable*. 


Figure  Relative  probability  of  inter¬ 

request  times. 
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Figure  3.7.  Relative  probability  of  requested  drum. 


•The  delete  meohanlsm 
Is  discussed  in  Section 

3.*. 


nseg{.)  ■  no.  of  segments  requested 
rdwr{ . )  *  rd-wr  distribution 
npg ( . )  =  no.  pages  requested 
drm(.)  *  requested  drum 
drmpos(.)  »  requested  drum  position 
n  *  no,  pages  this  request 
ns  *  temporary  segment  count 


Figure  3.8.  The  Processes  Model 
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The  reader  may  be  asking  what  Justification  there  Is 
for  assuming  the  particular  probability  distributions  that  have 
been  chosen?  In  particular  why  we  have  chosen  Poisson 
distributions  as  opposed  to  other  distributions.  It  will  be 
noted  that  these  choices  are  completely  arbitrary,  and  cannot 
be  properly  determined  until  some  statistics  are  available 
about  the  system  we  are  discussing.  It  Is  felt  that  the 
assumptions  that  have  been  made  are  reasonable. 


3.3.  The  Queue . 

The  model  of  the  queue  is  more  straightforward  and 
deterministic  than  the  model  of  the  processes.  When  a  request 
Is  received  from  a  process  it  is  entered  In  a  list  within  the 
Queue  Element.  Each  entry  in  the  list  contains  the  following 
Information:  an  identification  number  of  the  process  requesting, 
the  number  of  pages  Involved  In  the  transmission,  the  desired 
starting  location  on  the  drum,  the  Identification  number  of 
the  desired  drum,  and  whether  the  request  Is  a  read  or  a  write. 
The  number  of  pages  Is  an  Important  piece  of  Information  since 
It  can  be  used  to  determine  when  the  transmission  Is  ended. 
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A  possible  structure  for  the  Queue's  list,  which  we 
will  refer  to  simply  as  the  queue,  is  shown  in  figure  3.9. 

In  this  list  two  pointers  are  used,  one  to  indicate  the  lower 
limit  of  the  number  in  the  queue  (the  shaded  region),  the  other 
to  Indicate  the  upper  limit.  Both  pointers  are  periodically 
Incremented  and  are  modulo  capacity  of  queue.  The  lower  pointer 
is  moved  down  one  position  each  time  a  new  entry  is  cade,  and 
the  upper  pointer  is  moved  down  one  position  each  time  a 
request  leaves  the  queue.  If  the  next  out  is  not  the  least 
reoent  entry,  then  all  items  above  are  moved  down  one  position 
to  fill  the  gap.  The  shaded  area  represents  the  number  in 
the  queue,  frequently  referred  to  as  the  length  of  the  queue. 

There  is  a  Boolean  signal  received  from  each  of  the 
drums  indicating  whether  or  not  that  drum  is  busy  (all 
channels  to  it  in  use).  Whenever  all  channels  to  a  drum 
are  busy,  any  requests  arriving  for  that  drum  must  wait  in 
line,  end  a  waiting  line,  or  queue,  is  formed.  If  requests 
arrive  too  much  faster  than  thev  can  be  serviced,  the  length 
of  queue  could  become  equal  to  its  capacity  and  any  further 
requests  will  be  lost .  Such  a  development  is  disastrous, 
since  it  would  render  a  process  useless.  Hence  the  average 
arrival  rate  must  not  exceed  the  average  service  rate,  where 
the  rates  are  defined  to  be  the  reciprocals  of  the 
average  interarrival  and  service  times,  respectively. 


Figure  3.9.  A  structure  for  the  queue  stack 


When  the  Queue  is  aware  that  a  drum  is  not  busy5  it 
looks  down  the  list  to  determine  which  if  any  requests  want 
the  free  drum.  It  then  chooses  one  of  them  according  to  the 
queue  discipline,  assigns  it  to  some  free  channel  to  that 
drum,  the  deletes  the  entry  from  the  list. 

The  queue  discipline  is  simnly  the  rule  for  selection 
of  next  out.  We  consider  four  queue  disciplines  applicable  to 
our  situation: 

(1)  First  come,  fir-  t  served. 

(2)  Shortest  access  time  first. 

(3)  Shortest  Job  first. 

(4)  Mixed  policy. 

(1)  First  come  first  served. 

This  is  the  "fair"  or  "equitable"  queue  discipline, 
where  requests  are  serviced  in  the  order  of  their  arrival, 
and  is  the  case  when  the  "next  out"  of  Figure  3.9  is  the 
"latest  entry".  It  does  not  result  in  the  most  efficient 
operation.  It  is  analogous  to  the  normal  situation  encountered 
in  a  post  office,  when  one  wisning  to  buy  a  single  stamp 
must  wait  behind  a  Derson  with  several  packages.  Certainly 
the  waiting  time  is  greatly  Increased  because  of  ill  fortune, 
whereas  the  person  ahead  would  not  be  significantly  delayed 
to  give  way.  Since  a  process  is  equally  likely  to  ask  for 
any  drum  position,  and  since  the  present  drum  position  is 
likely  to  be  anything,  with  the  first  come  first  served  queue 
discipline  the  average  access  time  is  half  the  drum  revolution 
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time.  Let  us  represent  the  time  a  request  is  in  the  servloe 
system  (the  time  from  when  a  process  makes  a  request  until 
the  tiae  service  is  completed)  by  Tg.  Let  the  drum  revolution 
time  be  T.  Let  the  average  transfer  time  be  Tfc.  And  let 
the  average  wait  in  the  queue  be  Wq.  Then  for  first  come  first 
served, 

T  *  W  +  T«.  +  T/2  (1) 

s  q  t 

il i  Shortest  Access  lime  First. 

Under  this  queue  discipline  the  next  out  is  selected 

according  to  following  rule: 

Choome  the  one  for  which  the  rotational  positioning 
delay  until  the  desired  starting  address  is  minimum. 

Now  If  more  than  one  request  for  a  given  drum  is  in  the  queue, 

on  the  average  the  access  :lme  will  be  less  than  half  the 

drum  revolution  time;  this  is  so  since  with  more  in  the 

queue  the  probability  that  there  is  a  request  for  the  present 

drum  position  is  greater  than  for  a  queue  of  length  one.  It 

will  be  shown  later  that  the  minimum  access  time  is  roughly 

Inversely  proportional  fo  the  length  of  the  queue.  Hence 

for  this  queue  discipline 

Tn  «  W  +  Tf  T/n  (2) 

s  q  t 

where  r  is  the  average  number  in  the  queue,  and  Wq  is 
not  the  same  numberlcally  as  for  the  first  come  first  served 
queue  with  the  same  n.  Observe  that  the  shortest  access  time 
queue  is  a  dyn  ;mlc  priority  queue,  one  for  which  the  priorities 
of  requests  are  changing  randomly. 
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(3)  Shortest  Job  First. 

Under  this  queue  discipline  the  following  rule  Is 

used  to  seleot  the  next  out: 

Seleot  the  request  for  whloh  the  service  time  Is 
a  minimum.  The  service  time  Is  the  sum  of  the  access 
time  and  the  transfer  time. 

A  little  thought  should  convince  the  reader  that  under  this 
queue  discipline  the  access  time  Is  not  minimized,  but  yet 
It  will  In  general  be  less  than  T/2  for  queues  of  length  two 
or  more .  Hence 

Ts  «*  Vq  ♦  Tt  ♦  T*  (3) 

where  T/n  <  t '  <  T/2  ,  and  Wq  Is  not  the  same  numerically 
as  for  either  a  first  come  first  served  or  shortest  access 
queue  having  the  same  length  n. 


if 


1 


s 
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(4)  Mixed  Policy  Queues, 

It  will  be  noted  that  the  shortest  access  time  queue 
and  the  shortest  Job  first  queue  are  queues  In  which  a  continuous 
number  of  priorities  exist.  Suppose  we  become  concerned 
about  requests  which  might  have  to  wait  an  inordinately 
long  time,  perhaps  because  of  111  fate,  perhaps  because  Its 
Job  time  Is  long.  This  could  be  a  real  problem  In  the  shortest 
Job  first  case  (what  of  the  longest  Job  of  all?).  It  ought 
not  to  be  too  much  of  a  problem  In  the  shortest  access  time  case, 
since  each  time  a  request  Is  to  leave  the  queue.  It  has  an 
equal  chanoe  among  all  the  others  of  being  chosen.  This  Is 
only  partially  true  for  the  Shortest  Job  Pirst  Case,  Phere 
the  Job  time  has  a  random  component ,  the  access  time?  and  if 
the  transfer  time  component  be  very  long,  then  the  Job  time 
depends  almost  entirely  on  the  transfer  time.  Notloe  that  for 
very  short  transfer  times,  the  shortest  Job  queue  will  approach 
In  operation  the  shortest  access  queue.  One  way  of  circum¬ 
venting  the  nroblem  of  some  request  waiting  inordinately  long 
Is  to  Introduce  a  skip  limit  Into  our  model.  Each  time  a  request 
Is  skipped  over  as  next  out,  a  counter  associated  with  that 
request  Is  Incremented.  If  this  skip  count  ever  exceeds  the 
skip  limit  then  this  request  Is  next.  What  we  have  done 
In  essence  Is  to  add  a  first  come  first  served  component  to 
the  queue.  As  the  skip  limit  Is  lowered  a  shortest  access  time 
or  shortest  Job  oueue  behaves  more  and  more  like  a  first  come 
first  served  queue.  In  fact  a  queue  with  the  skip  limit  set 
to  zero  Is  Just  a  first  come  first  served  queue. 
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We  will  include  no  more  discussion  on  mixed  policy 
queues  since  the  problem  is  in  general  complex  and  unsolved. 

We  will,  however,  mention  the  skip  limit  once  again  in  Chapter  5 
under  the  discussion  of  simulation  results.  Finally,  another 
mixed  policy  queue  is  discussed  in  Appendix  3»  For  further 
discussions  on  the  matter,  the  reader  is  referred  to  the 
literature  <l,9,13fl5,l6) . 


( 5)  A  Comparison  of  Queue  Disciplines. 

In  Appendix  1  we  have  related  the  mean  number  in  the 
service  svstem,  which  includes  those  being  serviced  and  those 
in  the  line,  to  the  mean  and  variance  of  the  service  time 
distribution.  We  will  denote  the  number  in  the  system  by  L. 

The  random  variable  of  the  service  time,  t  ,  is  the  access 
tlme^t  ,  plus  the  transfer  time,  t,.,  The  service  distribution 
can  be  found  from  a  convolution  of  the  access  distribution  with 
the  transfer  time  distribution.  We  will  show  later  that 
both  of  these  can  be  found,  hence  the  service  distribution 
can  be  fou'd.  In  particular,  the  mean  service  time,  Tg,  is 


Ts  *  Ta  +  Tt 

2 

And  the  variance  of  the  service  time,  ,  Is 

s 

„  2  2.2 
°s  *  °t  +  °a 


(4) 


(5) 


since  we  are  assuming  Independence  of  t  and  t.  .  Let  us 

a  t 

2 

denote  the  function  relating  L,  T  ,  and  a  by 

L  -  MV’s  I  *  «W  °t> 


w 


3? 

The  function  F  from  equation  (6)  18  such  that  a  decrease 

o 

in  either  or  both  of  T  and  o  *  wlJi  result  in  a  reduction 

s  s 

In  L.  The  transfer  time  distribution  will  remain  the  same 
for  all  queue  disciplines  since  It  Is  a  function  of  the  number 
of  pages  per  segment,  which  Is  fixed  before  hand,  and  Is 
assumed  to  be  identical  for  all  processes. 

Let  the  total  number  of  processes  in  all  be  N,  Then 
«  *  w  ♦  L  (7) 

where  w  Is  the  number  of  working  prooesses.  The  efficiency 
of  a  svstem  can  be  measured  crudely  by  the  number  of  processors 
working,  and  Is 

efficiency  «  ^  »  — ■■■"  —  =  1-  |  (8) 

To  maximize  the  effloleney,  L  must  be  minimized.  Thus  the 
optimum  queue  discipline  Is  the  one  for  which  Is  minimized. 
Notice  further  that  the  number  of  processors  that  can  be 
kept  working  Is  just  the  number  of  working  proeessrs* 

number  of  busy  processors  =  w  =  N(1  -  jj)  (9) 

Por  the  simplest  system,  the  single-processor  system,  w  must 
nexer  be  less  than  one  If  the  processor  Is  to  be  continuously 
busy. 

On  the  average  transfer  time  Is  the  same  for  all 
queue  disciplines  (because  It  relates  directly  to  the  number 
of  pages  In  a  segment).  On  the  average  th*»  access  time  Is 
explicitly  minimized  only  by  the  shcrtest  access  tine  queue. 
Therefore  the  service  time  for  the  shortest  aocess  queue  wlllf 
on  the  average,  be  a  minimum,  compared  to  other  queues. 
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We  see  that  the  shortest  aocess  time  queue  minimizes  the 
service  time,  while  the  queue  which  bears  the  "shortest  Job 
first"  does  not  minimize  theaverage  servloe  time.  The 
apparent  contradiction  Is  resolved  when  we  realize  that  the 
shortest  access  queue  chooses  the  shortest  Job  first  on  the 
average .  while  the  "shortest  Job  first"  queue  selects  the 
shortest  Instantaneous  Job.  Nevertheless  equation  (6)  tells 
us  that  the  shortest  aocess  queue  must  have  minimal  L  associated 
with  It,  and  Is  therefore  the  most  efflolent*.  In  faot, 
any  queue  which  does  not  minimize  the  access  time  must  be 
less  efflolent  than  a  shortest  aocess  time  queue,  when 
efficiency  Is  defined  by  equation  (8).  Chapter  4  Is  devoted 
to  a  detailed  study  of  this  queue. 

Based  on  the  above  discussion,  we  give  the  Model  of  the 
Queue  In  Figure  3.10. 


"This  conclusion  Is  verified  by  simulation.  See  Chapter  5 


Wait  for  request 


Seleot  n»;xt  out  according 
to  queue  discipline  and 
skip  limit,  if  any. 


Send  drmpos,  npg,  progno, 
rd  or  m,  to  drum  no.  i. 


wr  «=  write 
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1*4.  The  Drums. 

Since  the  method  of  distributing  pages  on  the 
drum  is  of  considerable  importance,  we  will  discuss  it  first. 

Consider  Pigure  3.11.  The  drum,  we  suppose,  is  divided  into 
seotors  as  viewed  from  a  cross-section,  where  the  number  of 
seotors  is  an  integer.  The  number  of  words  per  page  is  just  the 
number  of  words  that  can  be  written  around  the  circumference 
of  the  drum  divided  by  the  number  of  sectors.  The  drum  is 
divided  into  rings,  and  the  width  of  one  such  ring  is  a  field. 

A  field  is  one  word  in  width,  and  a  word  is  typically  36  binary 

bits.  Each  field  is  subdivided  into  a  number  of  tracks,  each 

of  which  is  associated  with  one  read-write  head.  The  same 

head  is  used  for  reading  and  for  writing:  a  read  amplifier 

or  write  amplifier  is  connected  as  needed.  The  operation  a 

head  is  presently  performing  is  oalled  its  status,  and  there 

Is  a  delay  associated  with  switching  between  read  and  write 

status.  This  selection  delay  is  about  the  same  time  as  for 

three  or  four  words  to  pass  beneath  the  head,  so  ordinarily  f 

the  first  few  words  on  a  page  will  be  left  blank  to  allow 

for  this  delay. 

It  was  stated  previously  that  it  is  possible  to  write 
a  segment  of  N  pages  on  the  drum  contiguously.  We  indicate 
how  this  can  be  done.  The  question  is:  suppose  some  of  the 
seotors  in  a  field  are  used,  how  can  a  string  of  N  pages  be 
written  consecutively,  especially  if  a  page  woold  have 
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to  be  written  on  a  used  sector?  The  answer  is  that  we 
do  not  attempt  to  write  the  pages  in  the  same  field.  We 
require  only  that  during  a  write  operation  there  be  at  least 
one  free  field  per  sector.  Pirst  of  all,  suppose  that  each 
sector  was  allowed  to  have  all  but  C  of  its  fields  in  use, 
where  C  is  the  number  of  ohannels  to  the  drum,  and  where 
any  channel  can  access  any  field.  Suppose  further  that 
whenever  fewer  than  C  fields  were  free  on  a  given  sector  a 
deletion  occurred  immediately.  Then  the  drum  could  handle 
C  simultaneous  write  requests  because  a  free  field  oan  always 
be  found.  In  reality  a  delete  might  not  ooour  when  necessary, 
and  also  there  is  the  possibility  that  a  segment  Is  longer 
than  the  number  of  sectors,  which  implies  that  more  than  one 
of  its  pages  would  be  written  on  the  same  sector.  It  would 
be  better  to  set  a  drum  occupancy  level,  which  is  the  ratio 
of  allowed  fields  per  sector  to  the  actual  number  of  existing 
fields  per  sector: 

p  n 

occupancy  level  <  — ^ —  (1) 

where  P  is  the  number  of  fields  per  sector,  C  is  the  number 
of  ohannels  to  the  drum.  Then  whenever  the  occupancy  level 
is  exceeded,  some  sort  of  emergency  condition  would  be  set 
up,  and  any  unnecessary  segments  would  be  removed  from  the 
drum  (they  would  be  deleted,  or  they  might  be  moved  to  a 
lower  level  of  storage,  for  example  a  disc  file).  In  such 
a  case  the  occupancy  level  would  have  to  be  less  than  the 
upper  bound  set  by  the  equality  sign  in  (1)  to  allow  for 
statistical  fluctuations.  Simulation  has  shown  that 
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occupancy  levels  in  excess  of  93#  are  possible  with  a  proper 
deletion  pclley,  for  typical  parameters.  See  Chapter  5. 

When  a  write  request  comes,  the  pages  are  written 
on  the  drum  on  the  first  free  field  on  each  sectr"*,  and  a  pointer 
Is  left,  to  direct  a  read  operation  to  the  next  field  of  a 
consecutive  string  of  pages.  These  pointers  are  Indicated  by 
arrows  In  Figure  3.11.  Thus  It  Is  possible  to  have  a  string 
of  consecutive  pages  written  (and  read)  without  Interruption, 

We  require  rapid  Inter-field  switching,  a  feature  available 
on  high.*  speed  drums.  It  is  to  be  noted  that  if  the  drum  Is 
be  be  operated  this  way  It  will  have  to  maintain  Its  own 
"Field  Usage  Table"  similar  In  principle  to  the  "Track  Usage 
Table"  used  In  CTSS  with  the  dlsc(2).  When  a  write  request 
arrives,  this  table  Is  consulted  to  locate  the  nearest 
free  field  on  the  given  seotor. 

As  long  as  the  Supervisor's  deletelon  policy  sees  to 
it  there  are  always  sufficient  free  fields  on  each  seotor,  the 
drum  operation  Is  straightforward.  The  delete  mechanism  shown 
In  Figure  3.12  determines  how  many  pages  are  to  be  deleted  from 
the  drum;  It  does  this  whenever  the  desired  occupancy  level 
Is  exceeded.  We  may  model  the  behavior  of  a  deletion'  by 
picking  a  random  drum  address  and  deleting  one  page  from  each 
sector  until  N  pages  are  deleted.  A  "deletion"  may  be  to 
remove  the  offending  pages  to  a  lower  level  of  storage,  or 
It  may  be  to  obliterate  the  pages  entirely. 
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Once  a  channel  la  assigned,  the  drum  observes  whether 
the  request  Is  a  read  or  a  write,  and  switches  the  heads  associated 
with  that  field  to  that  status,  as  soon  as  the  starting  sector 
Is  *ppoolte  the  heads.  Note  that  the  set  of  heads  associated 
with  a  given  field  may  be  In  use  by  different  requests  from 
sector  to  sector.  When  the  starting  page  is  In  pos^  .on,  the 
data  transfer  begins,  allowing  time  for  the  switching  delay 
at  the  top  of  each  page.  Three  or  four  words  left  blank  on 
a  page  Is  sufficient  time  for  this.  At  the  bottom  of  each  page 
is  an  End  of  Page  mark,  with  a  pointer  to  to  the  field  containing 
the  next  page,  which  initiates  switching  to  that  field;  of 
course  the  heads  there  are  put  Into  the  proper  status. 

Finally,  at  the  end  of  the  last  page  of  the segment,  an  End 
of  File  mark  will  be  encountered,  and  the  channel  Is  freed 
for  the  next  request. 

The  Ideas  for  the  drum  model  are  embodied  In  Figure  3.13» 


Jf  lnlshedj 


ptotal  =  total  no.  pages  on  drum 
pet  *  per  cent  drum  occupancy 
dpg  *  no.  pages  to  be  deleted 
pg  =  temporary  page  count 


Figure  3.12.  The  delete  mechanism 
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CHAPTER  4.  THE  SHORTEST  ACCESS  TIME  QUEUE. 

4.1.  Introduction. 

In  Section  3.3  it  was  shown  that  the  shortest  access 
tine  queue  discipline  is  the  most  efficient;  It  Is  the  purpose 
of  Sections  4.2  and  4.3  to  analyze  this  queue  as  best  can 
be  done.  The  shortest  acoess  time  queue  Is  a  special  form  of 
the  shortest  Job  first  Queue.  Solutions  have  been  obtained 
for  shortest  Job  first  queues  with  the  Input  rates  Independent 
of  the  queue  length.  No  solutions  heve  teen  obtained  for  a 
shortest  .lob  queue  In  which  the  Input  rate  Is  dependent  on 
the  queue  length,  that  is,  when  there  is  onlv  a  finite  number 
of  requestors.  In  the  next  two  sections  we  do  not  attempt 
to  solve  for  the  probability  densities  of  queue  length, 
waiting  times,  and  service  times;  rather  we  talk  only  of  the 
averages,  which  become  time  Independent  at  equilibrium,  w.  en 
the  input  rate  to  the  system  Is  the  same  as  the  output  rate 
from  the  system.  In  Section  4.2  we  derive  a  probability 
density  function  for  the  minimum  access  time  as  a  function 
of  the  mean  number  In  the  queue;  then  In  Section  4.3  we  combine 
these  results  with  the  results  of  Appendix  1  to  obtain  some 
approximate  expressions  for  the  number  In  th'  queue,  and  for 
tne  waiting  time  in  the  que..:. 
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4.2.  The  Minigug  Access  Time  Distribution. 

The  access  time  Is  defined  as  the  time  from  the  exit 
of  a  request  from  the  queue  until  the  requested  starting 
sector  has  come  opposite  the  read-irrifce  heads.  It  Is  c'mply 
a  positioning  time.  We  have  shown  In  Section  3.3.5  that  a 
queue  discipline  which  minimizes  the  access  time  Is  the  most 
efficient;  we  wish  to  derive  the  access  time  distribution 
In  this  section,  and  in  a  later  section  we  will  determine  the 
waiting  times  in  queue  using  the  Pollaczek-Khlntchine  Formula 
(Appendix  1).  We  define  the  tilowlng  quantities,  given 
that  n  are  In  the  queue t 

R.  *  requested  starting  sector  of  the  drum  for  the  1th 
1  request  In  the  queue. 

D{t)  *  The  angular  drum  position  at  time  t. 

t*  h 

KAt)  m  required  accer.f.  time  at  time  t  for  the  1 
1  request  given  that  the  present  drum  position 

Is  D(t). 

a  n  random  variable  of  minimum  aocess  time,  which 

takes  on  values  a  . 

o 

T  =  drum  revolution  time. 

The  model  of  the  shortest  access  tine  oueue  discipline  shown 
In  figure  4.2.1  best  Illustrates  what  is  going  on. 

The  comparators  compare  Che  requested  starting  sector 
with  the  present  drua»  position  and  give  as  an  output  the 
required  access  time.  The  Kln{.)  box  selects  the  minimum  of 
Its  Inputs  and  sets  its  output  to  this  value.  To  simplify 
the  derivation  we  will  assume  that  the  Mln(.)  box  normalizes 
its  output  with  respect  to  the  drum  revolution  time  T,  so 
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Figure  4.2.1.  Operation  of  shortest  access  queue. 

that  a  Is  a  fraction  between  0  and  1.  We  have 

a  *  |  Min  [A^tJ.Agtt) . A^t)]  {1) 

where  0  <  a  <  1  .  We  are  Interested  In  the  probability 
density  of  a  as  a  function  of  n,  the  number  in  the  queue. 

It  was  stated  in  Seotion  3.1  that  the  probability  density 
of  the  is  xml form,  that  is,  all  drum  sectors  are  equally 
likely  to  be  requested.  Further  we  are  assuming  random 
segment  lengths.  If  segment  lengths  and  starting  positions 
are  random,  the  present  drum  position,  which  is  the  drum 
position  lust  at  the  finish  of  the  last  request  (so  that 
the  next  request  is  about  to  be  assigned),  is  random,  and  by 
symmetry  and  the  independence  of  requests,  we  may  assume  that 
it  is  uniformly  distributed.* 

♦This  is  not  true  In  the  case  of  short  segments  because  the 
drum  will  have  rotated  only  a  short  distance.  This  matter 
is  discussed  further  in  Seotion  4.2,  page  63. 


*  ~J 
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But  If  D(t)  and  Bj^  for  each  i  are  uniform,  then  A^(t)  must 
be  uniform  for  each  i;  that  is,  the  i^  request*s  access  time 
is  equally  likely  to  be  any  fraction  of  a  drum  revolution. 
Figure  4.2.2  shows  the  density  function  for  A^Ct),  which  has 
been  normalized  with  respect  to  the  drum  revolution  time,  T. 


P.  (t/T) 

Ai 


Figure  4.2.2.  Acoess  time  for  1th  request. 

Now,  the  probability  that  a  >  aQ  is  Just 

P[*  >  aQ]  -  P[A1(tf>ao,...,An{tf)>ao]  t*  -  j 

But  the  Rj  are  Independent,  so  that  the  A^(t/T)  are  also 
Independent,  and 

P£a  >  ®0]  =  PCA1(t‘)>ao].,.P[An(t»)>ao]  t* 

But  PLA1(t,)>a£>]  is  Just  the  shaded  portion  of  Figure  4.2.2, 
and  1 8  simply  (1  -  aQ).  Then 

?Ca  »  aQ]  *  (1  -  aQ)n  (2) 

equivalently  P[a  <  aQ]  *  1  -  (1  -  aQ)n 

and  Pa(aQ)  «  gj-  P[a  < 

o 

*.<»„>  -  ”(1  -  ‘o’"'1  (3) 

Equation  (3)  is  the  probability  density  of  a,  given  that  n 

are  in  the  queue.  Figure  4.2.3  shows  Pa(aQ)  for  a  few  values 


of  n. 
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Figure  4.2.3,  Shortest  Access  Time  Distribution. 

By  the  definition  of  conditional  probability* 
PaN(Vn)  =  Pa/K(ao/n)PN(n) 

where  N  Is  the  random  variable  of  the  number  In  the  queue, 
which  takes  on  values  n.  Then 

PaN(Vn)  *  n(1  "  “o^1  PN(n) 

The  mean  access  time,  a  ,  Is 

*  =  ^  1  aon(1  '  V"'1  PN(n)  dao 

n=l  0 
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Integration  by  parts  over  aQ  leads  to 

1  -  sir  pn<»>  <5> 

n=l 

”o 

The  second  moment,  a  ,  Is 


a2  =  S  /Vfntl  -  a  )n**1PM(n)da 
n=l  0  0  N  0 


Integration  bv  parts  over  aQ  leads  to 


&2  =  i:.  n+1  n+2  PN(n) 

n=i 


The  variance  of  the  access  time  distribution  is  then 


—  2  .  2  T*2  r  2  rs  /  -  \ 

a  ^Tn+TTTn+H  PN  n 

•o 

-  <?> 

Note  that  we  have  not  specified  PN(n) ,  the  distribution  of 
the  number  In  queue.  Note  too  that  It  Is  not  the  same  as  the 
time  distribution  of  n.  It  In  the  distribution  of  number 
in  queue  as  seen  by  the  departing  requests — we  need  PN(n) 
taken  over  Instants  when  the  next  request  Is  extracted  from 
the  queue,  which  does  not  happen  at  uniform  Intervals.  It 
Is  a  reasonable  assumption*  that  Pjj(n)  Is  a  normal  distribution. 
This  Is  only  an  approximation,  since  the  normal  distribution 
would  allow  for  some  probability  of  negative  n,  which  Is 
physically  meaningless;  this  must  be  used  oarefully  when 


•Based  on  the  Central  Limit  Theorem 


52 


n  Is  small  enough  so  that  the  portion  of  the  normal  curve 
extending  below  n*0  Is  appreciable,  especially  when  the  variance 
of  PN(n),  ,  Is  large,  so  that  on»N.  (n)  Is 

PN(n)  -  — i —  expL-$(n  -  n)2/o^]  (8) 

V2non 

Putting  (8)  into  (5), 

*  '  nil  jkl  ^  erPC'i(n  '  ]  <9) 

And  putting  (8)  Into  (?), 

“*  ‘  nil  “«•-*<"  -  r‘,2/on  ]  (10) 

Equations  (9)  and  (1)  cannot  be  reduced  further,  even  If 

the  summations  are  taken  to  be  Integrations  over  the  Infinite 

Interval.  These  equations  do,  however,  yield  readily  to  a 

_  2 

comouter,  and  families  of  curves  for  a  and  a  have  been 

a 

assembled  and  are  shorn  in  Figure  4.«:.4  and  4.2.5.  The 
axes  are  normalized  so  that,  given  t t »  drum  revolution  time 
T,  values  of  access  time  can  be  found. 

We  wish  to  note  the  limiting  forms  of  eauatlons  (9) 
and  (10).  These  occur  for  n  »  1,  and  for  on  «  n.  Figures 
4.2.4  and  4.2.5  show  that  for  n  >  8  we  may  Ignore  the  effects 
of  on,  for  on  of  Interest  (see  Section  5.2),  with  only  a 
small  error.  Now  If  on  Is  very  small  compared  to  n  then 
the  normal  curve  approaches  a  unit  impulse  In  the  limit. 


if 
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nee 


and  the  sumaatlons  of  equations  (9)  and  (10)  reduce  to  a 

single  value,  taken  at  n  *  n.  Thus  for  o„  «  n: 

n 


0 


a 


a 


1 

n+1 


S+I  J  n/(n+2) 


at  n  =  n 

at  n  «  n 


(11) 

(12) 


It  is  to  be  noted  that  (11)  and  (12)  are  evaluated  at 
n  «  n,  and  that  the  approximation  is  very  good  if  the  conditions 
are  net;  this  is  evidenced  in  Figures  4.2.4  and  4.2.5»  where 
equations  (11)  and  (12)  have  been  drawn.  One  of  the  prime 
assumptions  of  this  derivation  is  that  the  drum  positions 
at  successive  request -granting  times  are  independent.  If  the 
drum  positions  at  successive  request-granting  times  are  not 
Independent,  then  the  access  distribution  is  in  error.  This 
is  the  case  if  the  average  length  of  requests  is  small  compared 
to  a  drum  revolution.  See  the  discussion  on  page  63, 

In  Apoendix  2  one  further  result  of  Interest  is 
obtained.  The  form  of  the  Drobability  density  for  the  waiting 
time  in  oueue  is  derived  and  is  shown  to  be  exponential.  This 
is  in  excellent  agreement  with  the  simulation  results  discussed 
in  Section  5.?. 


NORMALIZED 

ACCESS 

TIME 


AVERAGE  NUMBER  IN  QUEUE 

{jg.2 t!f. •  Aooeas  tine  normalised  w.r.t.  drum  revolution  time 
aa  a  funotion  of  average  number  in  queue. 
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.Figure  Standard  deviation  of  access  tine  .normalized  *rt  AVERAGE  N1 

drum  revolution  time*  as  a  function  of  the  IN 

average  number  in  the  queue. 
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4.3.  Examination  of  Shortest  Access  Time  Queue . 

The  solution  to  a  queueing  problem  In  which  the  pblloy 
is  based  on  a  continuous  number  of  priorities,  such  as  the 
shortest  .lob  first  and  shortest  access  time  queues,  is  not 
easily  obtainable.  In  particular  no  solution  has  yet  been 
obtained  for  a  finite  requesting  copulation,  under  a  shortest- 
job-first  type  queue  discipline,  since  the  arrival  y&te  of 
requests  tends  to  depend  heavily  on  the  size  of  tie  queue 
and  the  service  time.  As  the  queue  become  full,  the  rate 
of  arrival  of  requests  tends  to  slacken  because  there  are  fewer 
members  of  the  requesting  population  outside  of  the  service 
system.  In  this  section  we  will  derive  a  set  of  aDproximate 
equations  for  the  number  In  the  queue  as  a  function  of  input 
and  service  parameters,  and  Indicate  an  iterative  procedure 
for  sol^lna  them. 

We  supoose  that  the  queue  is  In  statistical  equilibrium, 
that  is,  the  system  has  been  In  operation  sufficiently  long 
that  the  time  average  of  number  In  the  system  Is  constant. 

We  shell  use  the  following  notations 

n  =  the  mean  number  In  the  queue. 

Wq  »  mean  wait  on  a  request  In  the  queue. 

T  =  drum  revolution  time. 

T  =  mean  service  time, 
s 


« 


1 


■i 
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Tfc  =  mean  transfer  time. 

T  =  mean  access  time. 

ft 

a  *  mean  arrival  rate. 

b  =  mean  service  rate. 

A  =  mean  Interval  till  the  next  "equest  from  one 
process,  from  the  time  It  resumes. 

s  **  mean  number  of  pages  per  segment, 

m  =  number  of  sectors  around  the  drum. 

N  =  population  size,  l.e.,  the  total  number  In 

the  oueue,  plus  the  number  In  service,  plus  the 
number  generating  requests. 

r  =  traffic  Intensity  ratio,  l.e.,  the  average 
number  of  busy  channels. 

In  the  previous  section  we  .'aw  that  due  to  Independence 
of  requests,  random  segment  lengths,  andrandom  present  drum 
position,  that  at  each  request-granting  time,  each  request 
was  equally  likely  to  be  next  out.  We  have  a  series  of 
Bernoulli  trials,  then,  with  a  probability  of  j  of  a  particular 
request  being  picked  at  a  given  trial,  and  probability 
(1  -  ^)  of  being  overlooked,  where  k  Is  the  number  in  the 
aueue  at  the  time  of  the  trial.  On  the  average  we  can  say 
that  the  probability  of  be*ng  chosen  on  any  trial  Is  approximately 
where  n  Is  the  average  number  In  the  queue.  Therefore 
the  probability  of  being  ohosen  on  the  kth  requesting-grantlng 
time  after  a  reouest  enters  the  queue  Is,  on  the  average, 
given  by  a  geometric  distribution,  which  we  denote  by  P(k). 
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Then 


PO?)  -  (i  -  i)k”1(J) 


(1) 


We.  wish  to  determine  the  waiting  time  of  a  request  in  the 
queue.  The  z-transform  of  equation  (1),  which  we  denote 
by  p£(z),  is 

P>( z )  -  £  (1  -  5)k”1(J)  zk 

K  k*l  n  n 

which  can  be  reduced  to  the  dosed  form 

pk(!?>  "  n"-"  In  '-  i)z  (2) 


The  mean  number  of  trials  before  the  given  request  is  next 
out  is 


k 


dz  pk(z)^z*l 


=  n 


(3) 


And  the  variance  is 

.2 


'k 
.  2 


*•  2  pk  z ' 

dz 

n(n  -  1) 


_d_ 

dz 


p£(z> 


(4) 


The  average  wait  is  Just  the  average  number  of  service 
Intervals  that  must  pass  while  a  request  is  in  the  queue. 
If  a  request  arrives  Just  before  a  service  begins  it  must 
wait  only  (n  -  1)  intervals;  if  it  arrives  Just  after  a 
service  begins,  it  must  wait  n  intervals,  as  given  by 
equation  (3).  On  the  average,  thei\  it  must  wait  (n  -  i) 
service  intervals.  The  wait  in  the  queue  is  therefore 


Wq  “  (n  "  *>  Ts 


(5) 
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Equation  (9)  Is  exact  only  when  the  arrival  and  service  rates 
are  Independent  of  the  number  In  the  queue,  which  Is  not 
the  case  In  the  finite  population  sy3tem  we  are  discussing. 

We  can  use  equation  (9)  because  there  must  exist  an  equivalent 
Infinite-population  system  whose  equilibrium  arrival  rate  Is 
the  same  as  the  arrival  rate  to  the  shortest  access  system 
when  It  Is  In  equilibrium.  We  proceed  to  substitute  the 
appropriate  quantities  into  (9)  and  then  solve  for  n,  the 
mean  number  In  the  at  equilibrium. 

First  note  that  r,  the  traffic  intensity  ratio,  is 


where  a  Is  the  arrival  rate  at  equilibrium.  The  probability 
of  finding  exactly  k  segments  In  a  block  of  n  pages  is 

P(K,n)  «  e~n/S  n*l,2,3,... 

where  s  Is  the  mean  number  of  pages  per  segment.  The 
waiting  time  between  polsson  arrivals  is 

P(t)dt  =  P(no  arrivals  during  time  Interval  t) 

X  P(one  arrival  In  time  Interval  dt) 


so  that  P{t)  ■  ae”<*t  t  >  0. 
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also  the  time  average  number  of  busy  channels! 

a  mean  arrival  rate 
r  "  So  =  mean  service  rate 

where  o  *  number  of  channels, 

b  =  mean  service  rate 

a  *  mean  arrival  rate. 

The  mean  number  In  the  service  system  Is  just  (n+r).  Now 
If  the  lnterarrlval  time  for  one  working  process  Is  A,  then 
at  equilibrium  It  must  be,  for  all  working  Drocesses, 

(n c  i  (10) 

Because  (N-n-r)  are  not  In  the  service  system,  and  are  therefore 
making  requests.  We  can  now  fill  in  (9)  to  get; 


(n  -  n  -  FT 

A 


(11) 


We  define  a  quantity  R  to  be 

D  J.  _£  JJ  (  1  -  +  \ 

cA  cA  ml  m  ' 


(12) 


Note  that  R  Is  an  Intensity  ratio  for  one  process,  and 


Ts  =  R  A  c 


Then  the  intensity  ratio  r  Is 


(13) 


r  * 


be 


- - -  =  R  (N  -  n  -  r) 

(N  '  n  -  r’  (14) 

Solving  (14)  for  r,  we  find 


r  =  (N  -  n)  1  +  B 


(15) 
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After  putting  (15)  into  (11)  and  performing  the  appropriate 
algebraic  manipulation,  we  find 


The  form  of  equation(l6)  h-»s  been  chosen  beoause  it  Is 
solvable  by  a  process  known  as  relaxation  (or  iteration), 
in  which  a  guess  at  n  is  put  into  the  right  side  of  (16),  keeping 
in  mind  that  R  «  R(n).  A  new  value  of  n  is  obtained.  This 
new  value  of  n  is  placed  into  the  right  side  of  (16)  as 
before,  yielding  yet  another  value  of  n.  This  process  is 
continued  until  the  new  value  of  n  is  the  same  as  the  previous 
value.  It  was  found  that  (16)  converges  rapidly,  within 
five  cycles. 

Collecting  the  results. 


(17a) 

Wq  ■  (n  -  £)  B  A  c  (17b) 

Ts  -  R  A  c  (17c) 

A  simulation  has  teen  carried  out  to  test  equations  (17). 
The  value  of  n  was  found  to  be  within  1<  of  the  simulated  values, 
the  value  of  Wq  was  within  S$,  These  answers  were  considered 
satisfactory  in  view  of  the  approximate  nature  of  the 
derivation. 

Due  to  the  nature  of  this  problem  we  are  unable  to 
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say  anything  about  the  standard  deviation  of  our  results. 

Simulation  has  shown  that  the  standard  deviation  of  the  number 
In  queue  Is  less  than  1.0,  while  the  standard  deviation  of 
the  waiting  time  was  In  general  somewhat  larger  than  the 
m^an.  In  particular,  one  simulation  reported  a  maximum 
wait  of  about  ten  times  the  m^an. 

As  a  final  note  we  want  tc  point  out  chat  one  of  the 
basic  assumptions  of  this  section  and  the  previous  section 
is  that  the  drum  position  Is  random  at  each  request-granting 
time.  This  means  that  the  drum  positions  at  successive  request¬ 
granting  times  are  Independent.  But  this  need  not  be  the 
case.  Suppose  for  Instance  that  the  transfer  time,  ,  is 
a  small  fraction  of  the  drum  revolution  tlme,T  (for  example, 
suppose  the  average  transfer  time,  Tfc  *  0.1T).  Clearly, 

If  this  Is  the  case,  the  drum  positions  at  successive  request¬ 
granting  times  are  dependent,  because  we  can  say  that  the 
probability  of  the  drum  being  only  0.1T  away  Is  much  greater 
than  being,  say,  0.5T  away.  This  Is  obviously  contradictory  to 
the  assumption  of  independent  drum  positions  at  successive  request- 
granting  t'mes.  Consequently  we  expect  the  access  time  to  be 
below  the  predicted  values,  since  the  probability  of  finding  a 
request  wanting  the  present  drum  position  is  greater  than 
If  the  drum  position  Is  random.  If  the  access  time  were 
smaller  than  the  predicted  values,  then  both  W  and  n  would 

be  smaller  than  predicted,  T  would  be  smaller,  and  the 

© 

system  operation  should  be  more  efficient.  Simulation  has 
shown  that  this  is  the  case,  that  efficiency  Is  Increased 
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when  segments  are  short.  In  particular,  since  (N-n-r) 
processes  are  working,  then  the  fraction  of  processes  that 
are  working  is 


N  -  n 


N  ( 1  ♦  ft) 


(18) 


If  n  substantially  decreases,  by  (1R)  the  efficiency  sub¬ 
stantially  increases.  The  greater  the  efficiency,  the 
greater  the  number  of  processors  that  can  be  kept  busy.  It 
is  to  be  noted  that  when  is  of  the  same  order  of  magnitude 
as  T,  or  larger,  then  the  drum  positions  at  successive 
intervals  become  independent,  and  the  analysis  of  this 
seotion  Is  valid. 
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CHAPTER  3.  THE  SIMULATION  RESULTS.  CONCLUSIONS. 

5.1.  Introduction. 

In  order  to  observe  the  operation  of  the  model  of 
the  entire  drum  system,  which  is  discussed  In  Chapter  3« 

It  was  decided  to  simulate  the  system.  Project  MAC  computation 
facilities  were  used;  the  simulation  was  written  In  SIM,  a 
new  simulation  language  conceived  and  Implemented  by  A.L.  Scherr 
at  Project  MAC  (1?).  SIM  Is  an  augmented  version  of  the 
MAD  programming  language,  adding  several  new  statements  to 
those  already  existing  In  MAD.  It  has  the  powerful  advantage 
that  the  logical  flow  of  the  simulation  Is  the  same  as  the 
logical  flow  of  the  actual  system.  Each  element  of  the  system 
(see  Figure  3.1),  namely  the  processes,  the  queue,  and  the 
drums.  Is  specified  In  the  simulation  as  an  Element  (which 
Is  translated  Into  a  MAD  external  function  by  a  SIM  pre- 
eomDller).  The  Inter-elemental  signals  shown  In  Figure  3.1 
are  Implemented  In  SIM  by  system  variables,  which  allow  a 
signal  to  be  transmitted  from  one  element  to  another.  A 
main  program  called  SIMSYS  coordinates  the  activity  of  the 
elements. 

Three  simulations  were  run.  One  was  a  simulation  of 
the  entire  drum  system  discussed  In  Chanter  3.  Another  was 
a  simulation  of  the  shortest  access  time  queue  discussed 
In  Chapter  4.  Section  5.2  discusses  the  drum  simulation,  and 
Section  5.3  discusses  the  queue  simulation.  A  third  simul¬ 
ation  was  used  to  develop  Appendix  2,  and  Is  discussed  there. 


5.2.  The  Drum  Simulation. 

The  three  elements  of  the  simulation  were  the  Users* 
Processes,  the  Queue,  and  the  Drums.  These  elements  and  the 
signals  that  were  passed  among  them  are  shown  in  Figure  3»1. 
The  logical  flow  of  each  element  Is  the  same  as  shown  In 
the  flow  graphs  of  Plgures  3.8A,  3.8B,  3.10*  and  3.12,  where 
the  models  of  the  Processes,  the  Queue,  and  the  Drums  are 
depicted. 

CTSS  has  available  a  random  number  generator,  which 
is  useful  In  the  simulation  of  the  Processes  to  generate 
the  probability  distributions  discussed  In  Section  3.2. 

The  random  number  generator  returns  a  number  between  zero  and 
one  from  a  uniform  distribution.  This  can  be  used  to  get 
numbers  from  other  distributions  In  the  following  manner. 

First  the  cumulative  distribution  of  the  given  distribution 
is  found,  which  will  have  probabilities  varying  between  zero 
and  one.  The  random  number  generator  can  be  used  to  select 
one  of  these  values  of  probability.  This  value  Is  substituted 
into  the  cumulative  distribution  which  has  been  solved  for 
the  random  variable.  In  the  drum  simulation  numbers  from 
exponential  distributions  were  needed.  Such  exponentially 
distributed  random  variables  can  be  obtained  in  the  following 
manner.  Suppose  we  want  to  select  a  random  number  from  the 
exponential  distribution  of  lnterarrlval  times,  which  has 
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) 

Ibeen  shown  to  be 

/  P(t)  =  ao“at  „  >  0  (1) 

Denoting  the  cumulative  distribution  by  Q(t),  we  have 

t  . 

/  Q(t)  =  /  ae“at  dt  =  1  -  e"at  (2) 

0 

Solving  for  t, 

t  *  -  J  In  (1  -  Q ( t ) }  (3) 

But  in  Q ( t )  all  probabilities  in  the  Interval  (0,1)  occur 
uniformly,  so  we  can  use  the  random  number  generator  to 
select  a  probabilty  Q(t);  substitution  into  (3)  yields 
the  desired  exponentially  distributed  random  variable,  t. 
Equation  (3)  was  used  in  the  Process  Model  to  select 
waiting  times  til  the  next  request,  and  to  select  the 
number  of  pages  in  a  segment. 

The  following  data  were  taken  during  a  typical 
simulation,  for  each  queue  discipline; 

(1)  per  cent  process  idle  time; 

(2)  waiting  time  in  the  queue; 

(3)  number  in  the  queue; 

(4)  service  times; 

(5)  access  times; 

(6)  channel  idle  times; 

(7)  number  of  fields  used  per  sector  on  the  drum. 
The  following  set  of  parameters  was  considered  typical. 
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Fractional  drum  occupancy.... 

Number  of  processes . 

Mean  Inter-request  time . 

Mean  number  pages  per  segment 

Read-wrlte  ratio . 

Number  of  drums . . 

Number  of  channels  each  drum. 
Number  of  fields  each  drum... 
Number  of  sectors  on  drum.... 

Number  of  words  per  page . 

Drum  revolution  time... . 


V 


3. 

3. 

256. 

64. 

64. 

16.7  msec. 


The  following  per  cents  of  process  Idle  time  were  found  for 


each  queue  discipline i 

First  come  first  served .  55 i 

Shortest  job  first .  44^ 

Shortest  Access  time  first .  Ui% 


Other  simulations  using  modified  sets  of  parameters 
(for  example,  two  drums  with  two  channels  each;  or  longer 
service  times,  that  Is,  more  pages  per  segment)  showed  the 
same  result — the  shortest  access  time  queue  discipline  results 
In  minimum  idle  time.  This  point  has  been  discussed  under 
our  comparison  of  queues  In  Section  3.3.5. 

Probability  distributions  of  all  data  were  taken. 


Three  of  them  were  of  particular  Interest,  and  are  reproduced 
here.  These  were  the  valtlng  time  In  queue,  the  number  In 
queue,  and  the  number  of  fields  used  per  sector  per  drum. 
These  are  plotted  in  Figures  5.1»  5.2,  and  5.3  for  each 
queue  discipline.  The  means  and  the  maximum  points  are 
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/ 

Indicated.  It  is  notable  that  the  mean  wait  for  Pirst  Come 
Plrst  Served  was  l?.l  msec,  while  for  Shortest  Access  Time 
First  and  Shortest  Job  Pirst  it  was  significantly  less, 

6.8  msec  for  Shortest  Job  Pirst  and  6.3  msec  for  Shortest 
Access  Time  Pirst.  A<raln  the  Shortest  Access  Time  Queue 
lead  to  the  minimum  wait.  It  is  also  of  significance  that  the 
shape  of  the  waiting  time  in  queue  dlstritutlon  is  exponential 
as  predicted  by  Appendix  2.  The  number  in  the  queue  (Figure  5.2) 
was  about  8  for  Pirst  Come  Pirst  Served,  and  half  that  for  the 
other  two  queue  dlsclollnes.  The  number  of  fields  per 
sector  per  drum  (Figure  5.3),  is  not  dependent  on  the  queue, 
but  is  dependent  only  on  the  deletion  oollcy,  which  is  shown 
1  .  Plgure  3.12.  It  is  interesting  to  note  that  it  is 
normally  distributed,  and  that  at  desired  occupancy  level  of 
90*  the  maximum  data  point  was  242  out  of  256  fields  used  (95$). 
The  mean  was  230  fields  used  (90<).  Tnls  wa«  for  a  sample 
of  24,500  points.  We  conclude  that  oocupancy  levels  in  exoess 
of  90^  can  be  maintained  without  over-flow. 

The  remaining  three  distributions  are  not  plotted  here, 
but  we  will  discuss  each  briefly.  The  service  distribution 
was  found  to  have  approximately  the  same  shape  as  the 
number  of  pages  per  segment  distribution,  but  it  was  distorted 
due  to  the  Inclusion  of  the  access  time  in  the  service  time. 

The  mean  service  time  was  found  to  be  the  sum  of  the  mean 
access  time  and  the  mean  transfer  time,  as  expected. 

The  access  time  distribution  was  uniform  for  First 
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Come  First  Served,  with  a  mean  of  16.7/2  msec  *  8.34  msec,  asl 
expected,  tor  Shortest  Access  Time  First  this  distribution  V 
was  found  to  follow  closely  the  predictions  of  Section  4.2.  \ 

The  acoess  distribution  for  Shortest  Job  First  was  somewhere 
between  the  First  Come  Pirst  Served  and  Shortest  Access  Time 
distributions,  as  expected. 

Finally  the  channel  idle  time  distribution  showed 
that  there  was  an  insignificant  amount  of  channel  idle  time. 

Let  us  mention  what  the  maximum  waits  in  the  queue 
were.  First  Come  First  Served  hed  the  smallest  maximum 
wait,  as  expected,  and  Shortest  Job  First  had  the  largest. 

Some  numbers  are,  for  the  typical  parameters  listed  on  page  68, 

First  Come  First  Served .  62.  msec 

Shor  est  Acoess  Time .  65.  msec 

Shortest  Job  First .  100.  msec 

Note  that  the  Shortest  Access  Time  does  not  cause  waits 
too  much  longer  than  the  First  Come  First  Served  Queue. 

Other  simulations  were  run,  in  which  the  Shortest  Job 
Pirst  queue  was  observed  to  have  a  maximum  wait  of  4  sec, 
for  parameters  not  too  different  from  the  ones  listed  on 
page  68, 

A  last  point:  queues  in  which  the  skip  limit* 
was  used  h^ve  a  "First  Come  First  Served"  component,  and 
are  accordingly  less  efficient  than  a  Shortest  Access  Time 
oueue.  A  skip  limit  of  ten  in  a  Shortest  Access  Time  queue 
caused  its  efficiency  to  be  only  slightly  greater  than 


♦Section  3.3.^ 


Probability  densities  of  waiting  time  In  queue 
for  various  queue  disciplines. 


Probability  densities  of  number  in  queue 
for  various  Queue  disciplines. 
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Figure  5.4.  Probability  density  of  number  of 
fields  used  per  sector. 


a  Plrst  Come  First  Served  queue 


5.3.  Shortest  Access  Time  Queue  Simulation. 

This  simulation  was  composed  of  two  elements,  one 
to  make  requests,  and  the  queue.  With  Section  4.3,  the 
arrival  rate  of  requests  at  equilibrium  Is 

*  -  {frtk  <*> 


where 


8  *  &  <  rrr  +  S  > 


and  T  *  drum  revolution  time, 

A  =  Inter-request  times  per  working  process, 
c  *  number  of  channels, 

8  =  mean  number  of  pages  per  segment, 
m  *  number  of  sectors  per  drum, 
n  »  mean  number  In  the  queue. 

The  simulation  was  seeking  to  test  equations  (17)  for 

Section  4.3y  which  are 

n  =  - - - T~  (6) 

!  +  -il-t-B 11 

A  He (n  +  NR) 


Wq  =  (n  -  §)  R  A  c  (7) 

Four  single-channel  (c  =  1)  simulations  are  considered  here. 
The  parameters  were: 


Parameter  , 

set  number 

2 

3 

4 

T 

16.7  msec 

16.7  msec 

16.7 

msec 

16.7  nsec 

A 

15.0  msec 

5.0  msec 

0.5 

msec 

1.0  msec 

s 

4.0 

8.0 

40.0 

2.0 

m 

64.0 

64,0 

64.0 

32.0 

N 

20.0 

10.0 

25.0 

5.0 
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The  results,  were,  for  simulation  samples  of  about  3000  data 
points,  as  follows. 

T1  W 

Parameter  q 


set  number 

predicted 

simulated 

predicted 

simulated 

1 

12.85 

12.97 

27.78 

msec 

26.91  msec 

2 

7.96 

7.99 

29.48 

N 

29.01  " 

3 

24.00 

23.63 

260.98 

M 

259.12  " 

4 

3.98 

4.00 

15.30 

M 

16.54  * 

It  is  apparent  that  the  agreement  Is  good. 

One  last  point s  In  Section  4.3  It  was  mentioned  that 

If  the  drum  position  Is  not  random,  that  Is,  when  short 

segments  were  used,  then  the  access  times  should  decrease, 

and  in  particular  the  number  In  the  oueue  and  the  waiting 

times  should  decrease.  The  following  simulation  verified  thlsi 

Parameters: 

T  *  16.7  msec 
A  =  7.0  msec 

Function  of  time 
n 

2.48  11.40  msec 

There  Is  a  significant  difference,  and  fortunately  the 

errors  are  In  favor  of  much  Increased  operational  efficiency. 

From  Section  4.3  the  efficiency  Is 

N  -  n 
N(l  +  R) 

Efficiency :  Random 


Function  of  time 
»  46jt 


s  =  3.3 
m  =  64.0 


Results : 


n 


Random 

W 


3.86 


17.11  msec 


32* 
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5.4.  Conclusions. 

In  this  paper  we  have  shown  that  for  a  segmented 
multiprogrammed,  multiprocessor  computing  system,  the 
following  is  true*  proper  maintenance  of  auxiliary  memory 
oan  greatly  improve  system  efficiency.  We  have  shown  how 
this  can  be  done.  In  particular: 

(1)  It  is  generally  possible  to  store  pages  consecu¬ 
tively  on  the  drum,  and  proper  deletion  policy 
can  be  used  to  maintain  occupancy  levels  in 
excess  of  90%. 

(2)  The  Shortest  Access  Time  queue  discipline  is 
the  most  efficient  queue  for  an  auxiliary 
memory,  where  time  is  -pent  waiting  for  mechanical 
parts  to  move  into  some  proper  position. 

If  request  sizes  are  large,  that  is  if  segments 
contain  many  pages,  then  it  is  not  difficult 
to  derlv  equations  for  the  average  number  in 
queue,  and  for  the  average  wait  in  the  queue. 

If  the  segments  are  short,  these  equations  break 
down,  but  provide  an  upper  limit  for  the  average 
number  in  queue  and  the  average  wait  in  queue  I 
The  error  is  in  favor  of  Increased  efficiency. 

(4)  A  reasonable  probabilistic  model  for  the  processes 
in  a  segmented  computing  system  has  been  given 
in  this  paper. 
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(5)  Simulation  is  a  particularly  useful  tool  for 
analyzing  problems  of  the  complexity  of  computing 
systems,  for  it  is  frequently  helpful  in  providing 
a  starting  point  for  analysis. 

(6)  Hixed-Policy  queues  may  be  used  in  drum  (or 
disc)  auxiliary  memory  systems  when  we  become 
concerned  that  some  requests  might  hive  to  wait 
inordinately  long.  A  "skip  limit"  queue  was  found 
to  be  more  efficient  than  a  "window"  queue  (see 
Appendix  2). 

5.5.  Suggestions  for  future  study . 

(1)  The  deletion  policy  of  the  Processes  model . 

Although  it  is  possible  to  prevent  drum  overflow, 
and  to  maintain  90^  occupancy,  exactly  what  deletion 
policy  is  the  best,  if  any?  See  chapter  2  and 
Section  3.4  for  discussion. 

(2)  The  "page -turning"  vs.  " segment-turning"  allocation 
problem  of  Chapter  2  should  be  considered  in 
detail. 

(3)  The  finite  population,  shortest  Job  type  of 
queue  is  yet  to  be  complete'' y  analyzed. 
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APPENDIX  1.  THE  POLLACZEK-KHINTCHINE  FORMULA . 

In  this  appendix  we  will  derive  an  equation  whloh 
Santy  (16)  refers  to  as  the  Pollaozek*»Khintchlne  Formula 
(Saaty,  pp  40-43).  Saaty  has  dorlved  It  for  the  poisson 
Input,  single  channel,  eaulllbrlum  queue.  We  will  extend  the 
reasoning  to  include  the  c-channel  server.  Since  we  talk 
only  of  the  number  In  the  system,  the  queue  discipline  Is 
Irrelevant  to  our  discussion,  until  we  begin  to  talk  of 
waiting  times. 

Suppose  that  arrivals  oocur  at  random  aoeording  to 
a  poisson  process  at  a  rate  a  per  unit  time,  to  a  waiting 
line  In  statistical  equilibrium,  before  a  c-channel  facility. 
They  are  served  according  to  some  arbitrary  service-time 
distribution  at  a  rate  b  rer  unit  time  per  channel.  We  assume 
that  If  the  service  rate  of  one  channel  Is  b  per  unit  time, 
then  It  Is  be  per  unit  time  for  all  c  channels  operating 
together.  Sunpose  that  a  departing  request  leaves  q  In  the 
system  behind.  Including  those  In  service,  and  that  some  time 
t  will  elapse  before  the  next  departure.  Let  the  waiting 
line  Increase  In  length  by  k  requests  during  this  one 
service  Interval.  If  the  next  departing  request  leaves  q' 
behind  In  the  system,  we  can  relate  q  and  q'  as  follows: 

q'  =  max  (q-1,  0)  +  k  =  q-  l  +  d  +  k  (1) 

where  d(q)  =  0  if  q  >0 

d(q )  =  1  if  q  =  0 

Fy  Introducing  d(q)  we  sllminate  the  max  expression. 
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We  assume  that  equilibrium  values  for  the  first  and 

2 

second  moments  E(q)  and  E(q  )  of  the  number  in  the  system 
exist,  where  we  are  treating  q  as  a  random  variable.  We  note 
that  E{q)  *  E(q')  and  E(q  )  =  E(q'  )  since  both  q  and  q*  are 
assumed  to  have  the  same  equilibrium  distribution.  We  observe 
that  since  equilibrium,  eafch  departing  request  must  leave 
behind  identical  time-independent  queues,  each  having  the 
same  probability  distribut'on.  Now,  from  the  definition, 
d  *  d,  and  q(l  -  d)  =  q.  Thus,  taking  the  expected  value  of 
(1)  we  have 

E(q ' )  =  E(q )  -  E(l)  +  E(d)  +  E(k)  (2) 

but  since  E(q)  =  E(q')  we  have 

E(d)  =  1  -  E(k)  (3) 

During  an  inter-departure  interval  of  length  t  we  have 


eo  .  . 

E(k)  =  2  k'  e“at  =  at  (4) 

k=0 

E(k2)  *  n2  e~at  =  (at)2  ♦  at 

k=0  (5) 

Let  us  denote  the  combined  service  distribution  for  all 
c  channels  operating  in  parallel  by  S(t),  Taking  the 
expectation  of  E(k)  with  respect  to  this  service  time 
distribution  we  see  that 


E(k) 


E(k) 


/  (at)  S(t)  dt 
0 


a /  t  S(t)  dt 
0 


(6) 
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since  the  mean  of  S(t)  Is  1/bc.  But  since  se  have  not 
specified  S(t),  E(k)  =  r  Is  unaffected  by  the  type  of  service 
distribution.  Then 

E(d)  -  1  -  r  (7) 

Now,  If  the  probability  of  the  queue  Increasing  by  k  Is 
Independent  of  the  length  of  queue,  q,  and  of  d,  which 
depends  only  In  q,  any  expectation  over  products  of  r,  q, 
and  d  Is  .lust  the  product  of  the  respective  expected  values. 
Therefore 

E(kZ)  *  /  {(at)2  ♦  at)  S(t)  dt 
0 

which  Is  an  average  over  all  time.  But 

-  «  -  •* 

E(k2)  «=  /  (at)2  S(t)  dt  ♦  /  (at)  S(t)  dt 
0  0 

2  ~2 

*  a  tfi  +  at8 

p 

But  the  variance  of  S(t),  a  ,  Is 

s 


Therefore 

E(k2)  =  aZ(og2  +  t2)  ♦  atg 

Finally, 

Elk2)  =  o2»s2  .  r2  +  r  r  =  £  (8) 

If  we  square  both  sides  of  equation  (1): 

q’2  =  (q  -  l)2  ♦  2(q  -  l)(d  ♦  k)  ♦  (d  +  k)2 

q*2  =  q2  -  2q(l  -  k)  ♦  (k  -  l)2  ♦  d(2k  -  1)  (9) 


82 


2 

Equation  (9)  was  obtained  by  using  qd  =  0,  and  d  =  d. 
Because  of  equilibrium, 

E(q2)  -  E(q'2)  *  0  =  2E(a)E(k  -  1)  +  E((k  -  l)2) 

+E(d)E(2k  -  1)  (10) 

Reoall  that  the  validity  of  (10)  depends  on  the  Independence 
of  q  and  k.  Solving  for  E(q)  and  using  equations  (6),  (7), 
and  (8),  we  have  the  Pollaczek-Khintchine  Formula! 


E(q) 


E(q) 


Thus,  once  we  know  the  variance  of  the  service  time  distribution, 
the  average  number  in  the  system,  E(q)  is  determined.  It 
is  Important  to  note  that  E(q)  is  an  average  taken  over 


Instants  Just  following  departures,  and  is  not  the  time 
average.  If  E^(q)  is  the  time  average,  all  we  can  say 
without  further  argument  is  that 

E(q)  <  Et(q)  <  E(q)  ♦  1 


In  general  the  average  ’'.amber  in  the  service  system  equals 


the  sum  of  the  a^crf;re  number  of  busy  channels  (here  it  is 
r  *  )  plus  the  average  number  in  ’’ine. 

To  obtain  the  average  wait  in  the  waiting  line,  which 
we  will  denote  by  E(w),  we  observe  that  a(E(w)  +  ££  )  Is  the 
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expected  number  of  arrivals  during  the  expected  time  of  one 
req  st  in  the  service  system,  if  the  queue  discipline  is 
first  come  first  served,  because  ^  is  the  mean,  service  time. 
But  this  must  be  just  the  number  in  the  system  Immediately 
after  a  customer  departs,  that  is,  E(q),  so 


We  have  pointed  out  that  r  is  just  the  number  of  busy  channels 
and  that  E(q)  is  the  expected  number  in  the  svstem.  Inspec¬ 


tion  of  (11)  will  show  that  the  number  in  line,  Lq,  must  be 


We  have  the  interesting  and  Important  result 


Notioe  that  this  is  exact  only  if  the  number  in  the  system, 

E(q),  is  independent  qf  the  service  time  or  the  arrival 

rate,  as  Dointed  out  after  equation  (10),  We  also  note  that 

if  (W  +  cr)  is  the  time  of  one  customer  in  the  service 
q  dc 

system,  then  bcfW^  +  ^  )  is  one  more  than  the  number  in 
the  system,  E(q).  This  is  so  because  if  E(q)  are  in  the 
system,  then  E(q)  -  1  service  intervals  pass  while  one  request 
is  in  the  system.  Therefore  bcW^  =  E(q)  and  we  have  the 


second  result 


In  words: 


(14) 


u  _  average  number  In  the  line 
q  “  average  arrival  rate 

average  number  In  the  system 
average  service  rate 

These  are  true  for  arbitrary  service  distributions. 

It  Is  interesting  to  note  that  If  the  service  times 
are  exponential,  that  Is,  th.p  service  follows  a  poisson 
law,  then  the  Interval  bet • -en  departures  Is  given  bv 


S(t)  =  bce"bct  t  >  0 

It  Is  a  well-know  fact  that  for  this  type  of  distribution 
the  variance  equals  the  mean  squared,  that  Is, 


of  =  I  t2bce"bct  dt  -  [/~tbc  e"bct  dt J2 
Z  0  0 

2 


=  (l/bc) 

Substitution  of  this  Into  (11)  yields 

r2 

q  i  -  r 

From  which  It  follows  that 


L  = 


and 


q  1  -  r 
E(q)  = 


(15) 

(16) 
(17) 


1  -  r 

Consider  for  a  moment  the  geometric  distribution 


85 


It  is  known  that  this  distribution  describes  the  number 
in  a  service  system  with  exponential  input  and  output 
(Saaty,  17,  pp  38ff),  The  expected  number  in  the  svstem  is 


L  =  £  k  rK  (1  -  r) 

k  =  0 

oo 

-  (1  -  r)r  £  I  rk 
dr  k=l 


r 

=  1  -  r 

which  is  the  same  as  (17).  Then  we  can  find  the  variance 
of  (18)  which  is 


£  k2  rk  (1  -  r)  -  L2  =  (1  -  r)r  r  £  £  rk  -  L2 

dr  _q 


Oj2  =  L(L  +  1) 


+ 


(1 


(19) 


We  have  the  result  that  for  the  exponential  input,  exponential 
output  system  the  number  in  the  system  is  given  by  (17), 
the  number  in  queue  by  (16),  and  the  variance  of  the  number 
in  the  system  by  (19).  The  results  of  this  section  will  hold 
for  aueues  in  which  the  discipline  1?  random  as  well  as  for 
first  come  first  served.  They  hold  for  random  disciplines 
because,  on  the  average,  the  number  of  service  intervals 
that  must  oass  before  service  is  the  same  as  for  first 
come  first  served.  This  is  seen  in  Section  4,3,  In  fact 
the  equation  for  the  mean  number  in  the  queue,  is  accurate 
if  the  following  conditions  are  satisfied: 
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(1)  all  requests  stay  In  the  queue  until  served; 

(2)  the  service  time  distribution  for  all  channels 
Is  the  same,  with  parameter  b; 

(3)  ohannels  serve  one  at  a  time; 

(4)  a  channel  serves  the  next  request.  If  any  are 
are  waiting  In  the  aueue,  as  soon  as  It  finishes 
with  the  last  request, 

A  little  thought  will  show  that  if  these  four  rules  hold, 
the  length  of  the  oueue  Is  the  same  for  all  disciplines, 
although  the  mean  wait,  W  ,  will  vary,  (Morse,  13,  p.  117). 

4 
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APPENDIX  2.  WAITING  TINS  IN  A  SHORTESf  ACCESS  QUEUE. 

In  this  appendix  the  probability  density  function  for 

the  waiting  time  In  a  shortest  ac°ss  tine  queue  Is  derived. 

We  define  the  following  random  variables: 

A  *=  r.v.  of  access  time,  taking  on  values  a. 

N  -  r.v.  of  number  of  requests  to  exit  the  queue 

before  a  given  request  exits,  taking  on  values  n. 

P  *  r.v.  of  number  of  pages  per  segment,  taking  on 
values  p. 

R  =  r.v.  of  number  of  requests  in  the  queue,  taking 
on  values  r. 

T  *  r.v.  of  transfer  time,  taking  on  values  t. 

W  =  r.v.  of  waiting  time  In  oueue,  taking  on  values  w. 
Since  ac  each  trial  (renuest-grantlng  time)  all  reouests 
are  assumed  to  be  eaually  likely  to  exit  next  (Section  4.2) 
the  distribution  of  N  Is  geometric.  As  on  Dage  58, 
equation  (1),  the  conditional  distribution  of  N  given  that 
R  are  In  the  queue  Is 

PN/R(n/r)  “  (1  “  (1) 

where  R  Is  the  random  variable  of  the  number  of  requests 
In  the  queue.  Denoting  the  density  function  of  R  as  PR(r): 

PNR(n,r)  =  PN/R(n/r)  PR(r)  (2) 

We  are  Interested  In  the  wait  In  queue,  so  we  have  defined 
the  random  variable  of  wait  to  be  W.  Then 

PWNR^w,n,r)  =  PW/NR^w//n,r^  PN/R^n/r^  PR^ 


(3) 
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Por  a  single  channel  queue  the  wait  In  the  queue  Is  N  access 
times  plus  N  transfer  times.  As  In  Section  3.2  we  assume  the 
number  pages  per  segment  to  be  a  random  variable,  P,  where 

Pp(p)  «  e2p  e“op  (4) 

and  c  Is  a  constant  nronortional  to  the  mean  number  of  pages 
per  segment.  If  T'  Is  the  drum  revolution  time  and  S 
the  number  of  sectors  around  the  drum,  then  the  transfer  time 
for  one  pages  Is  T’/S.  Denoting  the  random  variable  of  transfer 
time  by  T,  we  have  for  the  density  function  of  Tt 

PT(t)  »  k2t  e"kfc  (5a) 

with  the  constant  k  defined  as 


and  }Ts  Is  the  average  number  of  pages  per  segment.  The  wait 
In  the  queue  *s,  from  above 

W  =  N  (A  +  T)  =  NA  +  NT  •  y  ♦  z 
with  y  NA  and  z  =  NT. 

Prom  Section  4.2.  the  cumulative  distribution  of  the 
access  time  Is 

PCA  <  a0]  *  1  -  (1  -  ao)N 
But  y  *  NA.  Then 

PCr  <  a]  «  P[A  <  f]  =  1  -  (1  -  |)N 

=  i  -  cu  -  §rN/a]-a 


(6) 
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Now  let  u  =  -a/N.  Then 

p[y  <  a]  -  1-L ( 1  +  u)1/u  ]"a  '?) 

For  large  N,  u  approaches  zero  and  we  know 

u^0  LI  +  u]1/u  -  e  (8) 

Thus  for  large  N,* 

P[y  <  a]  «  1  -  e“a 

and  che  density  function  for  the  access  time  component 
of  the  wait  In  queue  Is 

Py(a)  *  P[y  <  a]  *  e“a  (9) 

Using  an  elementary  p.  obablllty  transformat 5 «:it  the  density 
function  for  z  =  NT  Is 

».im  -  I  >  -  s4  b  .-<“»* 

Defining  Kn  »  k/N  *  S/T'NNs  we  have 
pz(h)  =  b  e’Knb 

Since  A  and  T  are  Independent  random  variables,  the  conditional 
density  function  for  W,  given  N  and  R  Is 

00 

Pw/NH(w)  «  /  P  (w-x)  PZU)  dx 

«»oo  * 

the  convolution  of  P(a)  and  P  (b).  This  evaluates  to  be 


*Thls  approximation  is  surprisingly  good  for  N  »  10, 
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Recalling  equation  (3), 


PrfNR^M,n,r^  *  pw Ai ^ w/n  , r)  Pw/R(n/r)  PR(r) 


■  W/NR 


N/R' 


Putting  (1)  and  (12)  Into  (3), 


?WNR(w*n*?i  “  *  W  1(r)^pR(1')] 


Ww*n*r) 


Ht/n)‘ 

( (k/n)-l) 


5  «"*  fB(r) 


If  N  Is  large,  as  It  Is  assumed  to  be,  then  PR(r)  Is 
approximately  Normal  by  the  Central  Limit  Theorem,  and 


WNR 


( w,n,r)  *> 


SJsMl 


~W 


( (k/n)-l)' 


s*zrr 


e-(r-R)2/2ar2 


(13) 

which  is  the  required  Iolnt  density  function  of  waiting  time 
in  the  queue.  The  simulation  has  shown  that  for  the  mean  queue 
length,  R,  greater  than  about  10  with  0’r«R  (which  Is  the  case 
when  R  >  10)  this  approximation  Is  valid.  Thus  In  the 
steady  state  situation,  It  Is  clear  that  the  probability 
density  for  walling  time  In  the  queue  is  approximately 
exponential,  s  fact  verified  by  simulation  (Section  5.2). 
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APPENDIX  J.  DESCRIPTION  OP  A  MIXED-POLICY  QUEUE. 

The  aueue  described  in  this  section  has  been  proposed 
as  a  shortest  access  time  aueue,  but  one  for  which  we  are 
concerned  that  a  particular  request  may  be  continually  over¬ 
looked  due  to  the  random  nature  of  selection.  Consider  for 
example  a  queue  which  has  many  requests  in  it  (at  least  thirty). 
Such  a  queue  might  occur  if  it  were  decided  to  request 
pages  singly  instead  of  in  segments.  Tn  Section  4.3  it 
is  shown  that  the  waiting  time  of  a  request  until  it  leaves 
a  random  output  oueue  is  given  by  a  geometric  distribution, 
with  the  expected  wait  equal  to  n  service  intervals,  where 
n  Is  the  average  number  in  the  aueue.  Now  if  n  is  large, 
then  it  is  conceivable  that  a  request  might  have  to  wait  for 
a  very  long  time:  the  variance  of  the  geometric  distribution 
is  (n)  (N  -  I)  a  r?'  if  n  is  large. 

ConslQ-  r  the  queue  shown  in  Figure  A3.1.  A  new  request 
is  always  added  to  the  bottom  of  the  stack,  A  section  of 
the  stack,  of  length  N,  is  considered,  the  remaining  requests 
in  the  queue  being  ignored  for  the  while.  We  shall  refer  to 
the  portion  of  the  queue  under  consideration  as  being  viewed 
through  a  window,  of  size  N.  The  top  of  the  window  is 
always  at  the  top  of  the  stack.  The  requests  in  the  window 
are  labelled  R1,R2,...,RJlJ  ,  and  are  considered  according  to 
the  shortest  access  time  first  queue  discipline.  Whenever 
the  reauest  marked  is  removed,  the  window  is  moved  down 
until  its  top  coincides  with  the  next  request  R^. 


It 


A.  L. 

appears  that  R^  might  have  to  wait  until  the  N  service 
time  before  It  leaves,  but  no  longer  (by  then  It  would  be 
the  only  reouest  In  the  window);  thus  It  seems  that  an  upper 
bound  can  be  placed  on  the  waiting  time  In  the  window, 
namely  (N  -  1)  service  Intervals,  But  this  Is  not  so. 

Consider  the  request  marked  R^j.  Suppose  by  some  quirk  of 
fate  that  requests  are  serviced  as  follows.  R^.Rg,..., 

^ *^N+1  *  *  *  *  * ^2N* would  happen  if  , . . , 
were  serviced  before  R^};  but  then  the  window  has  become 
positioned  at  P^,,  and  the  next  (N  -  1)  requests  could  be 
serviced  before  R„.  It  is  clear  that  the  maximum  wait  In  the 
window  Is  2(N  -  l).  Since  the  arrival  rate  Is  given  by 
an  average,  the  expected  wait  before  reaohlng  the  window  is 
M;  an  upper  bound  to  the  wait  Is  M  +  2(N  -  1)  service  Intervals. 
We  are  assuming  M  >  N. 

To  find  a  lower  bound  on  the  waiting  time,  consider 
the  following  argument.  Suppose  a  request  enters  the  queue 
.lust  before  the  window  makes  a  Jump  of  N,  then  suppose  the 
window  moves  one  position  at  the  end  of  each  service  Interval. 
The  request  In  question  would  then  wait  only  (M  -  N)  service 
Intervals  to  reach  the  window.  Then  suppose  it  were  let 
out  immediately.  The  minimum  wait  Is  therefore  M  -  (N-l) 

*  (M  -  N  +  1).  We  have  set  an  upper  limit  on  the  waiting  time: 
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and  the  lower  limit  of  waiting  time  Is 

“.in  D>  S  (2> 

Equations  (1)  and  (2)  assume  that  M  >  N. 

On  the  average  the  window  Is  not  full.  We  can  think 
of  the  oroblem  as  a  flow  problem,  with  requests  flowing  Into 
the  bottom  of  the  wondow  at  the  rate  of  one  per  service 
interval,  and  filtering  out  through  the  window  at  the  same 
rate.  Let  us  Imagine  one  of  the  requests  being  tagged  so 
that  we  can  keep  track  of  it.  If  we  know  on  the  average  how 
far  down  the  window  a  request  moves  before  It  exits  then 
we  know  the  mean  wait  In  the  window.  Simulation  of  the 
problem  for  several  window  sizes  was  carried  out,  and  It 
was  found  that  on  the  average  the  tagged  request  went 
half  way  down  ths  window  before  exiting.  Then  we  can  write 

“a,  ■<*♦!>  ‘a  <31 

figure  A3. 2  shows  the  probability  densities  of  a  request 

being  at  various  positions  in  the  window.  It  Is  to  be  noticed 

that  the  tagged  request  spends  considerably  more  time  at  the 

upper  and  lower  ends  of  the  window  then  at  the  center. 

The  standard  deviation  was  found  to  be  0.8  of  the  mean,  so 

N 

the  contention  that  the  request  Is  a  ^  on  the  average  Is 

not  too  certain.  This  Implies  that  the  probabilities  of 

Wmax  and  Wmln  are  not  smal*‘  Figure  A3. 3  shows  the  probability 

density  of  window  .lumps.  The  average  window  .lump  Is  about 
N 

Figure  A3. 4  shows  the  followings  the  mean  position  reached 
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by  the  tagged  request,  and  the  mean  w!ndow  movement  when  it 
moves,  both  as  a  function  of  window  size, 

Recall  that  for  efficient  access  time  queueing  the 
mean  in  the  queue  had  to  be  at  least  eight.  Hence  we  would 
require  that  the  window  length  be  N  >  16.  But  since  M  >  N, 
the  overall  queue  would  have  to  have  an  expected  length  M  +  N  >  32. 

It  appears  that  the  use  of  the  minimum  access  time 
queue  without  the  window,  but  with  the  "skip  limit"  mentioned 
in  Section  3.3.5  is  better  for  the  following  reason.  The 
skip  limit  could  be  set  to  an  upper  limit  of  2(N  -  1)  so  that 
the  maximum  wait  for  that  queue  would  be  the  same  as  given 
by  equation  (1),  but  with  M  =  0.  Since  the  "skip  limit" 
queue  with  the  same  maximum  is  longer  than  the  corresponding 
"window"  queue,  the  access  time  is  shorter,  and  more  efficient 


queueing  is  had 


NUHBER  TO  ESTER  WINDOW  WHEN  IT  NOVEIJ 
Probability  density  of  number  entering  window 
when  It  moves. 


99 


APPHHDIX  h.  A  CONTINUOUS-TIME  MARKOV  MODEL. 

With  Howard  (11,  pp.  92ff)  we  define  a  rate  Matrix  LA], 
having  elements  a^.  The  rate  matrix  Is  similar  to  the 
familiar  Markov  transition  probability  matrix  except  that  the 
elements  a^  represent  transition  rates  from  the  1  n  to  the 
J  state.  The  rates  are  assumed  to  be  taken  from  exponential 
distributions.  A  transition  matrix,  then,  is  a  discrete  form 
of  a  rate  matrix.  Since  we  consider  an  equilibrium  system 
the  overall  rate  of  change  must  be  zero.  Define  a  state 
probability  vector  P,  where  P  =  LP^tPg t • • ♦ ,P^3  and  p^  Is  the 
probability  that  the  svstem  has  1  requests  in  It.  Because 
of  equilibrium, 

[P][A]  *  0  (1) 

We  make  the  following  assumptions. 

(1)  All  requests  .loin  the  queue  and  do  not  leave 
until  service  Is  complete. 

(2)  Each  channel  serves  one  request  at  a  time,  and 
does  not  begin  the  next  request  until  the  present 
request  Is  finished. 

( 3)  As  soon  rs  a  channel  becomes  Idle,  the  next  request 
enters  service,  provided  there  are  some  In  the  queue. 

(k)  The  oueu®  discipline  Is  first  come  first  served, 
or  else  random.  For  any  other  queue  discipline 
th-'t  satisfies  (1)  through  (3)  the  expressions 
for  state  probabilities  and  average  number  in 
line  are  the  same,  but  the  waiting  time  In  the 
queue  is  not  the  same.  See  closing  remarks  of 
Appendix  1. 

We  use  the  following  notation: 

M  =  the  size  of  the  finite  number  number  In  the 
total  population  being  considered — it  Is  the 
sum  of  the  number  In  the  service  system  olus  the 
number  making  requests. 
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a  as  mean  request  rate  per  requestor,  where  1/a  = 
mean  Interarrival  Interval  per  requester, 

b  =  mean  service  rate  per  channel,  where  1/b  =  t  , 
the  mean  service  time,  s 

c  =  the  number  of  parallel  channels  providing  service. 

Pn  *  the  probability  of  the  service  system  having  n 
of  the  M  possible  requestors  In  it. 

If  the  system  in  in  state  n  (indicating  that  n  requests  are 

in  the  service  system,  and  that  (M  -  n)  are  remaining  outside 

in  the  requesting  population)  then  the  rate  of  exit  to  the 

state  (n+1)  is  nb  for  n  <  e  and  is  cb  for  n>c.  We  have  the 

rate  matrix 


La] 


-Ma  Ma  0  0 

b  -b-(M-l)a  (M-l)a  0 


2b 


•  *  •  •  i  t 


•  •  •  •  •  • 


1  •  •  . 


-2b-(M-2)a  (M-2)a 


cb 

0 

0 


th 

At  the  c  row  the  matrix  is 


-cb-2a 

cb 

0 


•  t  •  •  •  • 


2a  0 

-cb-a  a 
cb  -cb 


•  •  * 


(c-l)b  -(c-l)b-(M-c+l)a  (K-c-fl)a  0 
0  cb  -cb-(M-c)a  (M-c)a 


•  •  • 


0 


0 


cb 


-cb-(M-c-l)a 
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Because  of  equation  (1)  we  can  write 
-Map0  +  bp1  =  0 

Mapo  -  bp^  -  (H-l)ap^  +  2bpg  =  0 
and  In  general 

(M-n+l;apn_^  -  nbpR  -  (M-n)apn  +  (n+l)bpn+1  =  0  l<n<c 
(M-n+l)apn_1  -  cbpn  -  (M-n)apn  +  cbpn+1  =  0  c<n<M 

Adding  the  nth  and  the  (n-l)th  equations,  which  is  equivalent 
to  adding  adjacent  columns  in  £a] ,  we  have  by  recursion 

Pi  *  Mrpo 

M-l  M(M-l)  2 

P 9  a  “5“  rPi  =  ?  r  P„ 


n 


=  H(H.l)(Mr2)tlALMrn 1  r*p 

n! 


so  that 


MJ _ n, 


P  =  ,tst~V7  r  P„  (Xn<c 

*n  n!(M-n)J  *o  - 


_  M»  n  _1 

pn  "  c'(M-n):  r  cn-c  ro 


(2) 


r"  — p  c<  n<K 


where  r  .  p  is  found  from  the  reouirement  that 

D  O 

M 

£  Pn  =  1 
n=0  n 


(3) 


po  = 


°r1  HI  _n  .  ”  WI  n  _1_ 

nfo  »).'  n!e  efTvnTT  cn-o 


(4) 
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If  h  Is  the  average  number  of  processes  actually  In  operation, 
k  the  number  being  serviced,  and  the  number  In  line,  then 

k  ♦  h  ♦  L  *  M  (5) 

q 


and  because  of  equilibrium 


(6) 


The  number  being  serviced  Is 

c-1  M  c-1 

k  =  Z  np„  ♦  c  Z  p„  -  «  -  I  (c-n)  Pn  (7) 

n=0  n=c  n=u 

The  number  In  line  Is 

M 

L  «  £  (n-e)  pn  (8) 

q  n=0  n 


and  as  usual  the  waiting  time  In  the  line  Is 


The  number  In  the  system  Is 

M 

L  =  L  +  k  *  £  np 

q  n=0  n 

The  efficiency  Is 

M  -  L  -  k 

number  of  working  processes  * _ q 

K  ”  M 

M 

M  -  £  n  p 

n=0  n 


(9) 


(10) 


The  summations  can  be  evaluated  on  a  computer  without  too 

much  difficulty  If  the  factorials  are  expressed  as  logarithms, 

and  use  Is  rjp.de  of  the  fact  that 

n 

"I  =  exp  [  £  In  (1)] 

1-1 
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It  Is  Interesting  that  a  closed  form  for  (10)  can  be 
obtained  when  there  is  one  channel,  l.e.,  when  c=l.  In  this 
case  equations  (2)  become 


pn  =  (M-n) !  ^Po  (11) 


and  (k)  becomes 


P„  = 


Jo  ^ 


r  =  |  (12) 


Then  L  is  the  number  in  the  system,  and  L-r»L^  is  the  number 


in  tne  line. 


L  =  P„  r  r  rn 


o  ***** 

°  „£.o 


(13) 


Consider 

«zi  „  £  ifesjtSj  r"  =  £  Tj-gW  r"  (14) 

P0  n=0  (M-n)!  n-0  (M“n“1,! 

expanding  (14)  we  find 


^  =  M  +  M(M-l)r  +  M(M-l)(M-2)r2  +  ...  (15) 

P~ 


But 


-L  =  1  +  Mr  +  M(M-l)r2  +  M(M-l) (M-2*r3  +  ...  (16) 


Comparison  of  (15)  and  (16)  reveals  that 


=  (i  -  1  )  i 

P0  po  r 


Solving  for  L, 


L  =  M  - 


1  -  Pr 


(1?) 


(18) 
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